C FILE  COPI*  ADA050890 


X ^ ARI  TECHNICAL  REPORT  TR-PR.AI 

CO/ViPUTERIZED 
COLLECTIVE  TRAINING 

FOR  TEAMS 

/ N FINAL  REPORT 


V 


PrtRarcil  for 


rJ 


It 

Pill  Tbiraoirf 
H.  Dowoy  Kribs 

smsOK),  PAIA,  INt 


-D  ^ - 
r^  ’-"  ■ ' 

U,  m 7 1978 

rA 

i I ‘'  I ' 

j u i—i ‘ 


U.S.  ARMY  RESEARCH  INSTITUTE  for  tbo  behavioral  t social  sciences 
i defense  advanced  research  projects  agency 


Approved  for  public  release:  distribution  unlimited. 


U.  S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A Field  Operating  Agency  under  the  Juriadiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


J.  E.  UHLANER 
Technical  Director 


W.  C.  MAUS 
COL,  GS 
Commander 


Rnearch  performed  for  the  Department  of  the  Army 
Sanson,  Oatt,  Decisions,  Inc. 


NOTICES 


DISTRIBUTION:  Primery  distribution  of  this  report  has  been  tnede  by  ARI.  Pleese  eddrtss  correspondence 
concerning  distribution  of  reports  to:  U.  S.  Army  Reseerch  Institute  for  the  Beheviorel  end  Social  Sciences, 
ATTN:  PERI-P,  6001  Eisenhower  Avenue,  Alenendria,  Virginia  22333. 

PINAL  DISPOSITION:  This  leport  ipey  be  destroyed  when  it  it  no  longer  needed.  Pleese  do  not  return  it  to 
the  U.  S.  Army  Research  Institute  for  the  Behavioral  end  Social  Sciences. 

MOTE:  The  findings  In  this  report  ere  not  to  be  construed  as  an  official  Department  of  the  Army  position, 
unless  so  designated  by  other  authorised  documents. 


UNCLASSTVTm 

StCURITY  CLASSIf-ICATlON  OF  THIS  PAGECtAril  Dma  h.ntvrrd) 


REPORT  DOCUMENTATION  PAGE 


RKAn  INSTHIICTinNS 
HKHIHh:  COMIM.KTINI.  MIHM 


. RECIPIENT'S  CATALOC  NUMBER 


S.  CONTRACT  OR  GRANT  NUMBE 


Paul^liunnond  ai^H.  Dewey/krlbs  j 


TdANC19-76-C-P(^42a 


S.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Sensors,  Data,  Declsloi^  Inc . - 
5404  Linda  Vista  Road 


t1.  CONTROrtUlNG  OFFICE  NAME  AND  ADDRESS 

US  Amy  Research  Institute  for  the  Behavioral 
Social  Sciences  (PERI-OK),  5001  Elsenhower  Ave., 
Alexandria.  VA  22333 


u.  MONITORING  AGENCY  NAMES  AOORESS^i/  different  fromConttolUngOffice) 


■sMUHI-Ijil.IJ  i ■ - X ———I 


ISa  DECL  ASSIFICATION/DOWNCR  AOING 
SCHEDULE  / 


17.  DISTRIBUTION  STATEMENT  (of  the  abstract  entered  in  Block  20,  if  different  from  R 


IS.  SUPPLEMENT  ARv  notes 


This  work  was  jointly  sponsored  by  ARI  and  the  Defense  Advanced  Research 
Projects  Agency  under  ARPA  Order  2887.  Contracting  Officer's  Technical 
Representative  was  J.  D.  Baker,  Educational  Technology  and  Training  Simula- 
tion Technical  Area.  ARI.  


19.  KEY  WORDS  (Continue  on  reverse  side  if  necessary  and  identify  by  block  number) 

Team  Training,  Instructional  Strategies,  CAI,  Collective  Training,  Small 
Group  Training,  Computerized  Team  Training,  Team  Training  CAI,  Computerized 
Crew  Training,  TACFIRE,  Staff  Training,  Embedded  Training,  Team  Training 
Instructional  Strategies 


20.  ABSTR  ACT  (Continue  on  reverse  side  if  necessary  and  identify  by  block  number) 

The  purpose  of  this  Investigation  was  to  empirically  demonstrate  and  evalu- 
ate a brassboard  for  computerized  collective  graining  for  yearns  (COLT^) . 

The  four  tasks  underlying  the  demonstration/evaluation  were  (1)  conduct  a 
state-of-the-art  assessment  of  Instructional  strategies  appropriate  for 
C0LT2,  (2)  derive  a conceptual  framework  for  COLT^  Instructional  strategies, 
(3)  conduct  a team  job/task  and  training  analysis  for  COLT^  on  the  Amy 
computerized  artillery  fire  control  system  (TACFIRE),  and  (4)  develop 


FORM 

I JAN  71 


EDITION  OF  I NOV  ES  IS  OBSOLETE 


IS  OBSOLETE 


UNCLASSIFIED 


/ 


Sf  I URITV  CLASSIC  IC  AnON  OF  THIS  PAGE /Whm  Data  F.ntrrrd)  


TACPIRE  team  training  scenarloa  for  the  purpoee  of  Instructional  strategy 
assessment.  The  procedures  Included  design  and  Implementation  of  a team 
ISD  model,  via  which  smaple  training  materials  were  developed.  The  materials 
were  adapted  to  the  team  training  version  of  the  PLANIT  CAI  system.  The 
COLT^  brassboard  was  demonstrated  at  the  US  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences,  Arlington,  VA.  The  results  of  the  develop- 
mental aspects  of  the  project  Indicate  that  many,  of  the  components  of  the 
team  ISD  approach  that  were  designed  for  tl)lp.-^fort  would  adequately  meet 
the  criteria  for  a generic  team  ISD  model. ^^^^eparatlon  of  team  learning 
objectives  and  evaluation  of  Interactive  team  skills  .are  deficient  areas. 
PLANIT  met  the  basic  team  CAI  requirements.  However,  enhancement  of  the  team 
training  directives  should  be  undertaken  In  order  to  (1)  broaden  the  CAI 
base  for  Instructional  strategies,  and  (2)  facilitate  authoring  procedures. 
Demonstration/evaluation  subjects  trained  on  the  sample  material  In  either  a 
team  or  an  Individual  mode.  The  results  preliminarily  Indicate  that  there 
are  differences  In  regard  to  what  types  of  behavior  are  learned  between  team 
and  Individual  Instruction. 
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FOREWORD 


The  Educational  Technology  and  Training  Simulation  Technical  Area  of  the  j 

Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  conducts 
research  to  support  the  development  of  training  concepts  and  evaluation  tech-  1 

nlques  for  applying  automation,  simulation  and  training  devices  In  a unit  I 

setting.  A training  concept  currently  under  study  Is  the  use  of  automation,  | 

viz. , tactical  computers,  for  training.  Tactical  computers  have  great  poten-  j 

tlal  for  presenting  Individual  and  collective  (or  team)  training.  Individual  j 

training  using  the  tactical  computer  has  been  developed  and  evaluated.  The 
development  of  team  training  was  an  expressed  priority  of  the  recent  Defense  | 

Science  Board  Report  to  the  Director  of  Defense  Research  and  Engineering.  In  | 

anticipation  of  the  Defense  Science  Board  Report,  the  present  Technical  Report  j 

(and  a previously  Issued  companion  report  - ARI  Technical  Report  TR-77-A4)  ’ 

reviews  the  problems  of  the  development  of  Instructional  strategies  for  con-  ? 

ducting  team  training  and  examines  the  potential  of  the  computer  for  controlling  | 

and  monitoring  team  training.  ] 

1 

The  research  reported  herein  was  jointly  sponsored  by  ARI  and  the  J 

Defense  Advanced  Research  Projects  Agency  (ARPA  Order  2887),  and  la  responsive 
to  specific  requirements  of  the  U.S.  Army  Field  Artillery  School,  the  Training 
Support  Center  of  the  U.S.  Army  Training  and  Doctrine  Command,  and  to  Army 
Project  2Q762722A764.  The  work  reported  on  here  was  performed  by  Sensors,  i 

Data,  Decisions,  Inc.  under  the  technical  monltorshlp  of  James  D.  Baker, 

Chief  of  the  Educational  Technology  and  Simulation  Technical  Area,  ARI. 


COMPUTERIZED  COLLECTIVE  TRAINING  FOR  TEAMS 


BRIEF 

Requirement 

Past  research  on  team  training  has  not  focused,  to  any  substantial  degree, 
on  establishing  a methodology  for  developing  team  training  curricula  or  on 
Investigating  the  potential  of  coiiq>uter  technology  as  a delivery  system  for 
team  training.  The  major  purpose  of  this  study  was  to  develop  an  approach  for 
'designing  team  training  scenarios  and  testing  the  feasibility  of  the  team 
training  version  of  the  PLANIT  CAI  system  as  an  Instructional  medium  for 
scenario  presentation. 

The  project  objectives  were  as  follows: 

1.  To  determine  from  the  existing  literature,  previous  surveys,  personal 
contacts  and  other  related  sources  the  Information  which  exists  with  regard  to 
state-of-the-art  findings  and  instructional  theory  directly  applicable  to  the 
problem  of  developing  instructional  strategies  for  conq>uter-asslsted  team 
training. 

2.  To  derive  historically,  analytically  and/or  empirically  a conceptual 
framework,  fleshed-out  with  detailed  principles,  for  a general  purpose  (non- 
job or  system  specific)  set  of  Instructional  strategies  applicable  to  team 
training  problems  In  a computerized  setting. 

3.  To  conduct  a detailed  job/task  analysis  for  two  classes  of  team 

training:  (a)  the  man-computer-man  paradigm,  and  (b)  the  man-(non-computer)- 
man  setting.  ^ 

.'i 

4.  To  develop  an  appropriate  scenario  representative  of  and  permitting 


the  assessment  of  the  job/task  analysis  and  which  will  permit  the  Insertion  of 
objective  2 team  training  strategies  Into  the  scenario  In  order  to  make  It  a 
training  scenario  rather  than  a purely  drill  and  exercise  vehicle. 
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5.  To  construct,  demonstrate  and  evaluate  a "brassboard"  team  training 
system  which  ties  meaningful  aspects  of  all  project  findings  together. 

Procedures 

Building  on  an  empiric2tl  and  theoretical  base  established  in  prior 
research,  a conceptual  framework  for  deriving  team  training  Instructional 
strategies  was  developed.  In  turn,  generic  individual  instructional  systems 
development  (ISD)  techniques  were  adapted  to  a team  training  ISD  model.  The 
model  was  utilized  to  derive  the  team  training  specifications  for  a segment  of 
the  U.S.  Army's  computerized  artillery  fire  control  system,  TACFIRE,  operations. 

On  the  basis  of  these  specifications,  saiiq>le  training  materials  which  reflected 
a selection  of  team  instructional  strategies  were  developed  and  adapted  to  the 
team  training  version  of  the  PLANIT  computer  assisted  instruction  (CAI)  system. 

The  'brassboard'  of  computerized  collective  graining  for  yearns  (COLT^)  was 
demonstrated  and  evaluated  at  the  U.S.  Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences  in  Arlington,  VA. 

Findings 

Team  operations  occur  in  a situational  context  which  is  a continuum;  the 
end  points  of  which  are  described  as  established  or  emergent.  An  established 
situation  is  one  for  which  performance  requirements  are  specifiable,  predict- 
able, and  comply  with  standard  operating  procedures.  In  an  emergent  situation, 
the  environmental  conditions  during  the  performance  requirements  are  unantici- 
pated, and  the  state  of  the  system  does  not  comply  with  standard  operating 
procedures.  Teams  operate  along  this  continuum  in  either  serial  or  parallel. 

Serial  activities  are  sequential  with  the  input  for  one  team  member  based  upon 
the  output  of  another.  Parallel  team  structures  are  characterized  by  team 
metiers  performing  the  same  or  interrelated  tasks  simultaneously. 
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Team  Instructional  strategies  are  defined  as  the  product  of  a series  of 
decisions  vhlch  provide  for  the  structuring  of  learning  activities  by  three 
types  of  information:  (1)  the  nature  of  the  task  to  be  learned,  (2)  the 
characteristics  of  the  learner  and  learner  strategies,  and  (3)  the  capability 
of  the  Instructional  delivery  system.  Underlying  the  development  of  team 
Instructional  strategies,  there  is  needed  a team  ISO  model  by  which  the 
specifications  of  the  Instruction  can  be  derived.  The  model  should  Identify 
team  task  dimensions,  team  objectives,  and  the  scope  and  sequencing  of  specific 
learning  events  for  both  established  and  emergent  contexts  and  for  both  serial 
and  parallel  structures. 

Team  training  scenarios  are  task  and  environment  specific  In  nature. 

That  Is,  there  must  be  adequate  incorporation  of  team  task  Interactions  In  the 
Instructional  strategies  underlying  the  scenario.  Then  the  team  Interactions 
must  be  placed  In  a simulated  tactical  environment.  Rich  combat  representa- 
tions built  Into  the  scenarios  may  be  critical  In  order  to  Involve  a COLT^ 
trainee  at  more  than  a drill  and  practice  level. 

The  team  version  of  PLANIT  adequately  provided  for  the  four  major  team 
CAl  considerations:  (1)  multi-person  Initialization  of  lessons,  (2)  communi- 
cation among  team  members,  (3)  synchronization  of  team  members  and  scenario 
events,  and  (4)  manipulation  of  a common  data  base  for  storing  and  retrieving 
scenario-related  information.  Enhancements  are  required  to  Increase  the  speed 
of  the  operating  system,  to  provide  greater  flexibility  In  communications,  and 
to  facilitate  authoring  procedures. 

The  results  of  the  demonstration/evaluation , while  limited  In  Inferential 
power  due  primarily  to  the  small  number  of  subjects  and  the  anecdotal  nature 
of  the  evaluation.  Indicate  that  there  are  differences  between  the  effective- 
ness of  team  and  Individual  Instruction  In  regard  to  what  types  of  behavior 
are  being  learned.  Supporting  this  claim  are  the  following  observations: 


1.  The  coordinated  (team)  training  did  not  seem  to  Increase  individual 
skills  as  well  as  continuous  indlvldtial  training, 

2.  There  appears  to  be  little  stability  among  Independent  variables  for 
explaining  variance  in  subject  scores  bet%reen  individual  and  team  contexts, 
and 

3.  Coordinated  behavior  lends  to  better  achievement  on  specific  tasks. 
Utilization  of  Findings 

The  findings  of  the  study  Impact  on  three  team  topics:  (1)  the  development 
of  a team  ISD  model,  (2)  requirements  for  a team  CAl  system,  and  (3)  require- 
ments for  team  training  research.  Kecommendations  for  future  developmental 
efforts  are  suggested  for  each  topic. 

Generally,  the  team  ISD  approach  as  designed  and  Implemented  was  insuffi- 
ciently fleshed  out  to  serve  as  a step-by-step  procedural  guide  for  developing 
team  training.  Deficiencies  Include  (1)  a methodology  for  preparing,  analyzing, 
and  categorizing  team  learning  objectives,  (2)  evaluation  designs  which  would 
address  team  member  Interactions  as  well  as  individual  and  team  achievement, 
and  (3)  the  incorporation  of  applicable  knowledge  regarding  small  group 
behavior  into  the  data  base  of  the  conceptual  framework  for  COLT^  instructional 
strategies. 

Recommendations  for  the  enhancement  of  PLANIT  focused  on  software  modifi- 
cations that  would  improve  system  operations  and  flexibility  and  design 
modifications  to  facilitate  authoring  procedures.  Recommendations  for  future 
research  emphasized  (1)  investigating  the  relationships  of  team  personnel 
composites,  achievement,  and  modes  of  COLT^,  and  (2)  testing  TACFIRE  training 
scenarios  in  an  operational  setting. 
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INTRODUCTION 

Team  training  has  been  an  active  topic  In  Department  of  Defense  and 
Civilian  Sector  training  researv'.h  arenas  for  over  two  decades.  Research 
projects  addressing  the  subject  have  been  extensive  and  have  Identified  many 
problems  whose  resolution  Is  critical  to  effective  team  functioning.  Yet  to 
date,  R&D  efforts  have  neither  resulted  In  the  establishment  of  a methodology 
for  developing  team  training  curricula  or,  to  any  substantial  degree.  Investi- 
gated the  potential  of  computer  technology  as  an  effective  and  efficient 
delivery  system  for  team  training. 

With  the  advent  of  coiiq>lex  computer-based  weapon  systems  which  necessitate 
coordinated  actions  of  multiple  operators  and  decision  makers,  team  training 
of  system  users  has  become  a critical  need.  Recognition  of  the  problem  by  the 
Army  has  led  to  the  Initiation  of  related  research  projects  by  the  U.S.  Army 
Research  Institute  (ARI)  and  by  the  Defense  Advanced  Research  Projects  AgCiO^v 
(DARPA).  Further,  the  ARI  research  which  Is  currently  focused  on  the  use  of 
computerized  tactical  data  systems  as  a major  Individual  training  medium  Is 
being  extended  to  Include  Investigations  of  the  feasibility  and  effectiveness 
of  embedding  team  training  on  the  Army's  computerized  artlllary  fire  control 
system,  TACFIRE. 

The  project  final  report  which  follows  provides  the  results  of  the  design 
and  application  of  a team  Instructional  system  design  (ISD)  methodology  In  the 
development  of  computerized  collective  graining  for  yearns  (COLT^) . In  essence, 
the  design  of  the  team  ISD  model  Involved  extending  generic  Individual  Instruc- 
tion systems  design  concepts  to  encompass  team  training  aspects  and  subsequently 
developing  a computer  assistance  Instruction  (CAI)  team  training  brassboard 
based  on  the  team  ISD  approach.  Thus,  the  methodology  directly  relates  existing 
knowledge  regarding  various  dimensions  of  Individual  and  team  training  to  the 


development  of  a specific  team  computer-assisted  Instruction  brassboard.  In 
turn,  the  brassboard  reflects  a sampling  of  instructional  strategies  which 
account  for  three  critical  components  of  team  training:  fl)  team  tasV  Hlmun 
slons,  (2)  individual  learner  characteristics,  and  (3)  CAI  capabilities. 

The  COLT^  lessons  developed  and  evaluated  were  designed  to  address  a 
specific  operational  Army  team,  an  artillery  battalion  TACFIRE  Fire  Direction 
Center  team  coiiq>osed  of  a fire  direction  officer  (FDO)  and  a fire  direction 
sergeant  (FDS).  The  team  training  Issues  which  emerged  during  the  course  of 
the  project  are  not,  however,  delimited  by  the  specific  team  environment  being 
dealt  with,  but  rather  are  generic  to  the  preponderance  of  military  team 
training.  The  Issues  are  compl&x  and  make  It  clear  that  a single  team  training 
methodology  without  flexibility  will  not  suffice  as  a derivator  of  team  train- 
ing requirements  and  as  a guide  to  the  development  of  effective  team  Instruction. 

It  Is  our  belief  that  the  team  training  approach  demonstrated  In  this 
project  embodies  the  comprehensiveness  required  of  a team  ISD  model  and  possesses 
the  flexibility  required  for  application  to  a broad  range  of  team  environments. 
The  conceptual  structure  of  the  project,  with  the  supporting  empirical  data, 
indicates  that  the  representation  of  the  Intersection  of  team  task  dimensions. 
Individual  learuer  characteristics,  and  Instructional  delivery  system  In 
instructional  strategies  Is  critical  to  effective  team  training.  In  'turn,  the 
methodology  proved  effective  In  deriving  team  task  dimensions  and  as  a guide 
for  team  curricular  materials  development.  The  methodology,  however.  Is  far 
from  being  fleshed  out  In  detail  or  from  being  adequately  tested. 

Organization  of  Final  Report 

The  remainder  of  the  Final  Report  is  organized  as  follows:  The 
Introduction  presents  a brief  description  of  the  TACFIRE  training  research 
which  leads  up  to  this  effort,  and  a listing  of  the  specific  tasks  undertaken 
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In  the  present  project.  The  second  section  contains  an  overview  of  the  | 

fundamental  Issues  underlying  team  training  and  their  Implications  for  develop-  I 

Ing  team  training  programs.  The  third  section  provides  a discussion  of  a < 

3 

conceptual  framework  from  which  COLT^  Instructional  strategies  may  be  derived. 

Prlmavlly,  the  three  critical  components  of  COLT^  Instructional  strategies — 
team  task  dimensions.  Individual  learner  attributes,  and  CAI  capabilities — 
are  reviewed.  Section  four  provides  a description  of  the  brassboard  develop- 
ment. The  major  focus  Is  on  describing  the  results  of  Implementing  the  team 
ISD  model  and  the  development  of  the  training  scenarios. 

The  results  of  the  brassboard  demonstrations  are  documented  In  section 
five.  The  sixth  section  Is  a discussion  of  overall  project  findings.  Section 
seven  contains  recommendations. 

Background  to  TACFIRS  Training  Research 

As  part  of  a long  range  plan,  ARI  is  engaged  In  an  effort  to  maximize 
utilization  of  tactical  data  systems  to  meet  tactical  training  needs.  The 
first  phase  of  ARI's  effort  toward  using  tactical  systems  In  an  Instructional 
mode  Involved  the  MASSTER  test  122  "IBCS:  Automated  Instruction"  project. 

This  project  demonstrated  the  feasibility  of  using  a prototype  tactical  data 
processing  system  In  a stand  alone  mode  to  support  unit  training  requirements. 

The  Instruction  developed,  however,  was  not  related  to  training  of  system 
users. 

The  second  phase  of  the  ARI  effort  to  employ  tactical  data  systems  for 
Instructional  purposes  Involved  embedding  training  that  was  directly  related 
to  the  operation  of  the  tactical  system  Itself.  One  benefit  of  embedded 
training  Is  that  It  can  provide  training  at  the  unit  level  and  location, 
thereby  reducing  or  eliminating  the  need  to  send  personnel  away  to  school. 

Embedded  training  also  accomplishes  general  familiarization  with  the  tactical 
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data  system  through  a self-instructional  mode.  That  Is,  personnel  who  are 
operators  or  who  are  Involved  in  maintenance  of  a tactical  data  system  are 
likely  to  have  little  experience  with  computers.  Thus,  instructional  material 
embedded  In  the  tactical  data  system  offers  an  additional  opportunity  to 
become  familiar  with  system  equipment  and  operational  characteristics. 

In  May  197^  ARI  contracted  with  System  Development  Corporation  for  the 
development  of  embedded  self-instructional  programs  for  users  of  the  TACFIRE 
system.  The  overall  aim  of  the  effort  was  to  extend  the  scope  of  computer- 
assisted  Instruction  to  the  development  of  self-instructional  programs  and 
procedures  for  TACFIRE  users.  The  basic  approach  was  to  embed  a training 
subsystem  package  within  the  operating  TACFIRE  system  and  to  use  the  system 
Itself  to  train  personnel  In  Its  operation  and  maintenance.  The  training 
goals  of  the  courseware  to  be  used  In  the  embedded  mode  were: 

1.  To  present  techniques  to  aid  the  users  In  learning  how  to  operate  the 
system. 

2.  To  exercise  and  update  system  related  skills. 

3.  To  provide  on-line  situational  problems  which  enable  the  users  to 
exercise  all  the  skills  previously  acquired  (Hoyt,  Butler  and  Leung,  1976. 

TACFIRE  courseware,  using  the  PLANIT  language,  was  developed  and  produced 
In  five  functional  areas.  The  average  course  time  for  this  Individualized, 
self-paced,  embedded  training  program  Is  approximately  40  hours  and  covers  an 
estimated  25  to  35  percent  of  the  Battalion  Fire  Direction  Center  operations 
(Hoyt,  et  al.,  1976). 

The  present  project.  Initialized  In  August  1976,  represents  an  extension 
of  the  scope  of  embedded  TACFIRE  training.  The  previously  mentioned  course- 
ware was  designed  to  develop  and  maintain  Individual  skills  In  operating  the 
TACFIRE  system.  The  objective  of  the  present  project  Is  to  demonstrate  and 
evaluate  training  of  TACFIRE  system  personnel  operating  as  a team. 
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Team  training  is  a function  of  the  requirement  for  coordinated  activity 
within  the  TACFIRE  environment.  As  a computerized  comnand/control  system, 
TACFIRE  has  a number  of  characteristics  that  are  conmon  to  all  such  systems. 

For  example,  the  system  is  operated  by  teams  of  people  whose  Interaction  with 
each  other  in  the  environment  is  mediated  by  the  computer  coiq>lex  with  associ- 
ated input/output  requirements.  Within  this  sophisticated  and  complex  computer- 
biased  weapon  system  environment,  it  is  essential  for  personnel  to  'cooperatively' 
perform  tasks.  The  division  of  individual  responsibilities  and  the  team 
member  interactions  require  a broader  training  scope  to  be  taken  than  currently 
exists.  Therefore,  the  ultimate  goal  of  this  project  is  to  investigate  the 
feasibility  of  extending  the  concept  of  embedded  CAI  training  beyond  individual 
instruction  to  the  training  of  teams. 

Project  Tasks  and  Objectives 

The  project  tasks  and  objectives  are  listed  below. 

Task  1;  State-of-the-art  assessment  of  instructional  strategies  for  com- 
puter-assisted team  training.  To  determine  from  the  existing  literature, 
previous  surveys,  personal  contacts  and  other  related  sources  the  Information 
which  exists  with  regard  to  state-of-the-art  findings  and  instructional  theory 
directly  applicable  to  the  problem  of  developing  instructional  strategies  for 
computer-assisted  team  training. 

Task  2;  Derivation  and  development  of  instructional  strategies  for  com- 
puter-assisted team  training.  To  derive  historically,  analytically  and/or 
empirically  a conceptual  framework,  fleshed-out  with  detailed  principles,  for 
a general  purpose  (non-job  or  system  specific)  set  of  instructional  strategies 
applicable  to  team  training  problems  in  a computerized  setting. 

Task  3;  Job/task  and  training  analysis  for  computer-assisted  TACFIRE 
team  training.  To  conduct  a detailed  job/task  analysis  for  two  classes  of 
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team  training : (1)  the  man-computer-man  paradigm,  and  (2)  the  man-(non- 

coiiq>utcr)'man  setting. 


r 


r 


'I 


Tajik  4 ; Scenario  development  for  Instructional  strategy  assessment.  To 

develop  an  appropriate  scenario  representative  of  and  permitting  the  assess- 
ment of  the  Job/task  analysis  and  which  will  permit  the  Insertion  of  Task  2 
team  training  strategies  Into  the  scenario  In  order  to  nmkg  it  a training 
scenario  rather  than  a purely  drill  and  exercise  vehicle. 

Task  5;  Development  and  demooatratlon/evaluatlon  of  a "brassboard"  com- 
puterized team  training  system.  To  construct,  demonstrate  and  evaluate  a 
"brassboard”  team  training  system  which  ties  meaningful  aspects  of  all  of  the 
preceding  Tasks  together. 
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AN  OVERVIEW  OF  MAJOR  TEAM  ISSUES 


Team  Definition 

Task  1,  a state-of-the-art  assessment  of  Instructional  strategies  for 
computer-assisted  team  training,  had  as  Its  objective  the  determination  of 
the  applicability  of  findings  of  previous  research  efforts  to  the  problem  of 
I developing  Instructional  strategies  for  coiiQ>uter-a8slsted  team  training.  In 

; the  undertaking  of  this  task,  the  Project  Team  was  quickly  confronted  with  the 

conq)lexlty  of  team  training  Issues  and  with  the  lack  of  xmanlmlty  within  the 
research  conmunlty  regarding  these  Issues.  For  example,  two  extensive  reviews 
of  team  training  (Hall  and  Rizzo,  1975;  Wagner,  Hlbblts,  Rosenblatt  and 
Schulz,  1976)  Identified  the  difficulty  In  defining  team  and  team  training. 

As  noted  by  Hall  and  Rizzo  "no  one  seems  to  be  able  to  articulate  Its  [team] 
dimensions  with  sufficient  clarity  to  permit  the  development  of  training 
procedures  for  producing  It."  It  was  further  stated  In  this  report  that 
another  major  Issue  that  lacks  resolution  was  the  determination  of  whether  a 
team  Is  simply  a collection  of  Individuals  performing  separate  task  jobs  In  a 
group  context  or  If  there  are  unique  trainable  team  skills  that  exist  over  and 
above  Individual  functions. 

The  first  of  these  issues,  that  Is,  the  definition  of  a team,  was  resolved 

by  employing  an  existing  description  of  a team.  The  description  was  based  on 

observations  offered  by  Klaus  and  Glazer  (1968).  They  stated: 

The  team  is  usually  well  organized,  highly  structured  and  has 
relatively  formal  operating  procedures  - as  exemplified  by  a 
baseball  team,  an  aircraft  crew,  or  ship  control  team.  Teams 
generally : 

(1)  Are  relatively  rigid  In  structure,  organization  and  com- 
munication networks. 

(2)  Have  well  defined  positions  or  numbers  assignments  so 
that  participation  In  a given  task  by  each  Individual 
can  be  anticipated  to  a given  extent. 


(3)  Depend  on  the  cooperative  or  coordinative  participation 
of  several  specialized  individuals  sdiose  activities  con- 
tain a little  overlap  and  who  naist  each  perform  their 
task  at  least  at  some  minimum  level  of  proficiency. 

(4)  Are  often  Involved  with  equipment  or  tasks  requiring 
perceptual  motor  activities. 

(5)  Can  be  given  specific  guidance  on  Job  performance  based 
on  a task  analysis  of  the  team's  equipment,  mission  or 
situation. 

Thus  the  criteria  for  team  definition  include:  (1)  rigid  structure, 
organization  and  conmunlcation  networks,  (2)  anticipation  of  an  individual's 
task  participation  by  virtue  of  well  defined  assignments,  and  (3)  cooperation 
and  coordination. 

Conceptual  Team  Models 

The  second  major  team  training  issue  is  related  to  the  conceptualization 
of  teams  into  two  models.  These  models  are  referred  to  as  "stimulus  response" 
and  as  "organismlc" . Alexander  and  Cooperband  (1965)  distinguish  between  the 
two  team  training  models  based  on  situations  in  which  the  team  behavior  takes 
place.  The  stimulus  response  model  was  applied  to  teams  which  operate  primarily 
in  an  established  situation  where  tasks  and  the  activities  required  to  perform 
the  operation  can  be  completely  specified  and  assignment  of  functions  among 
team  members  and  equipment  is  relatively  rigid.  In  the  organismlc  model,  the 
team  is  considered  to  be  a synthetic  organism  of  which  individuals  are  com- 
ponents. This  model  is  oriented  towards  teams  operating  in  an  environment 
which  Includes  a significant  proportion  of  emergent  situations.  In  emergent 
situations,  there  are  defined  task  assignments;  however,  the  individual  has  a 
considerable  degree  of  discretion  as  to  how  to  perform  the  task  given  various 
contingencies.  Consequently,  team  performance  depends  on  the  development  of 
appropriate  team  procedures  for  coping  with  environmental  contingencies  more 
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so  than  on  Individual  job  proficiency.  Thus,  adaptive  innovations  are  required 
by  team  members,  and  decision  making  and  problem  solving  skills  are  critical. 

The  two  conceptual  approaches  take  as  their  bases  the  situational  contexts 
in  which  team  behavior  occurs.  In  actuality,  the  situational  context  Is  a 
continuum,  the  end  points  of  which  are  described  as  established  or  emergent. 

Boguslaw  and  Porter  (1962)  define  these  situations  as  follows: 

An  established  situation  Is  one  In  which  (1)  all  action-relevant 

environmental  conditions  are  specifiable  and  predictable,  | 

(2)  all  action-relevant  states  of  the  system  are  specifiable 
and  predictable,  and  (3)  available  research  technology  or 
records  are  adequate  to  provide  statements  about  the  probable 
consequences  of  alternative  actions.  An  emergent  situation  Is 
one  In  which  (1)  all  action-relevant  environmental  conditions 
have  not  been  specified,  (2)  the  state  of  the  system  does  not 
correspond  to  relied  upon  predictions,  and  (3)  analytical  solu- 
tions are  not  available  given  current  states  of  analytical 
technology. 

The  two  conceptual  viewpoints  have  also  served  as  contexts  for  team 
training  research.  For  example.  Investigation  of  team  member  Interactions  In 
an  established  situation  was  a primary  focus  of  a team  training  laboratory 
program  at  the  American  Institute  of  Research  (Klaus  and  Glaser,  1960).  There 
are  obvious  advantages  to  the  team  training  laboratory  research,  but  the  often 
necessary  simplification  of  the  team  functions  can  mask  or  omit  possible 
Important  variables  which  Influence  behavior  In  the  real  world.  Abstracting 
the  situational  contexts  In  the  laboratory  can  result  In  a loss  of  opportunity 
for  trainees  to  react  to  breakdowns  or  problems  which  may  arise  In  an  opera- 
tional setting  (Wagner,  et  al.,  1976). 

Providing  skills  to  deal  with  emergent  unstructured  situations  was  seen 
as  a major  goal  of  an  earlier  team  training  program  (Alexander  and  Cooperband, 

1965) . The  development  of  coordination  skills  was  stressed  although  It  was 
recognized  that  these  are  based  upon  attainment  of  minimum  Individual  skills. 

In  turn,  team  training  devices  and  techniques  were  seen  as  requiring  orientation 
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for  training  innovative  behaviors  and  skills  necessary  to  adapt  to  unforeseen 
problems.  It  was  agreed  that  emergent  situation  training  permits  a more 
realistic,  less  abstract  approach  than  established  situation  training.  In  the 
emergent  case,  what  seems  to  be  Important  is  training  team  members  to  become 
fully  aware  of  their  responsibilities,  to  compensate  for  the  inability  of 
others,  and  to  overcome  teo^orary  problems  when  the  situation  calls  for  it. 

It  is  obvious  that  in  actuality,  no  team  operates  in  purely  an  established 

or  an  emergent  situation.  Therefore,  in  conducting  the  Job/task  and  training 

% 

analysis,  emphasis  was  placed  first  on  defining  the  precise  TACFIRE  established  j 

situation  as  prescribed  by  standard  operating  procedures  and,  secondly,  on 
identifying  the  most  conmon  and  critical  emergent  situations  that  Impact 
actual  operations  of  the  TACFIRE  system.  By  defining  both  the  established  and 
the  emergent  situations,  the  team  meiid>er  interactions  which  occur  in  both 
cases  could  be  analyzed  in  order  to  determine  the  team  task  dimensions  that 
are  present. 

Team  Structure 

A third  major  issue  underlying  the  development  of  team  training  is  related 
to  the  structure  (interaction  of  team  members)  of  team  operations.  Basically, 

I teams  function  either  in  serial  or  parallel.  In  a serial  or  vertical  structure, 

activities  are  sequential  with  input  for  one  team  member  based  upon  output  of 
another.  Parallel  team  structures  are  characterized  by  team  members  performing 
1 the  same  or  similar  tasks  simultaneously. 

i 

t Research  related  to  team  structure  and  effectiveness  has  had  mixed  results. 

t 

, For  example,  Briggs  and  Johnston  (1967)  suggested  that  parallel  team  structures 

are  preferable  to  serial  structures  because  team  performance  in  the  parallel 
structure  is  not  dependent  on  the  least  skilled  member.  On  the  other  hand, 
i Klaus  and  Glaser  (1968)  reported  that  the  parallel  structure  led  only  to  a 
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short  term  gain  and  eventually  to  a decrement  in  team  performance.  There 
Is,  however,  one  point  of  agreement.  In  a purely  established  situation  the 
serial  team  structure  results  In  better  performance.  In  the  same  situation, 
parallel  structures  seem  to  Inhibit  or  slow  down  team  performances.  On  the 
other  hand.  In  emergent  situations,  team  failure  Is  frequently  a function  of 
Individual  skill  deficiency.  Teams  apparently  respond  more  effectively  to 
emergent  tasks  If  a parallel  team  structure  Is  In  effect. 

In  a TACFIRE  operation  there  Is  neither  a pure  serial  nor  parallel  team 
structure.  What  commonly  Is  the  case  Is  that  more  than  one  team  member  will 
receive  similar  Inputs,  but  the  responsibility  for  output  Is  predetermined 
by  standard  operating  procedures.  In  the  event  of  emergent  or  contingent 
situations,  more  than  one  team  member  Is  prepared  or  should  be  prepared  to 
address  problems  which  arise. 

Implications  for  Team  Training 

Each  of  the  previously  discussed  Issues  should  be  taken  Into  consideration 
by  the  developer  of  a team  training  curriculum.  First,  the  definition  of  a 
team  contains  certain  criteria  which  distinguish  It  from  the  multl-lndlvldual 
task  context  as  well  as  a small  group.  Ultimately,  It  Is  these  same  criteria 
which  serve  as  the  foundation  for  developing  and  Implementing  a team  ISD 
approach  In  order  to  derive  Instructional  strategies  for  the  training.  For 
example.  If  the  criteria  of  (1)  a rigid  structure,  organization  and  communication 
network,  (2)  anticipation  of  an  Individual's  task  participation  and  (3) 
cooperation  and  coordination  are  not  present  to  some  degree,  any  other 
Issues  (l.e.,  the  conceptual  team  model  and  team  structure)  are  mute. 

If  there  Is  no  rigid  team  structure  or  standard  operating  procedure.  It 
Is  not  possible  to  determine  an  established  situation  for  the  team  performance. 

On  the  other  hand.  If  cooperation  and  coordination  are  not  Integral  components 


of  the  team's  operations  then  emergent  situations  do  not  Intact  on  the  team 
as  a whole  but  only  on  the  Individuals  operating  within  the  group  context. 
Further,  If  there  is  not  overlap  within  the  Individuals'  task  participation 
by  virtue  of  the  defined  assignments,  then  the  team  operation  will  be  In  Its 
purest  sense  "a  stimulus-response"  model  and  will,  in  effect,  represent  only 
a multi-person  operation.  The  Inverse  of  this  situation  is  also  true.  That 
Is,  If  there  are  no  defined  assignments  related  to  specific  task  operations 
but  all  Individuals  are  cooperatively  addressing  all  tasks  without  defined 
structure  and  organization,  then  it  is  likely  that  the  team  Is  in  fact  a 
small  group,  should  be  defined  as  such,  and  the  more  general  rules  of  small 
group  behavior  applied. 

Once  a team  has  met  the  criteria  for  definition  as  a team,  the  second 
and  third  major  team  training  Issues  discussed  begin  to  have  a tremendous 
Impact  on  the  subsequent  development  of  the  training  curriculum.  Primarily, 
the  connection  is  via  the  team  Job /task  and  training  analysis.  The  team 
Job /task  and  training  analysis  must  be  co^>rehenslve  enough  to  provide  for 
the  identification  of  both  standard  operating  procedures  tasks  and  unantici- 
pated coid>lnatlons  of  known  tasks  as  well  as  the  emergence  of  previously 
unaddressed  and  untrained  to  performance  requirements.  Thus,  there  is  a 
direct  tie  from  the  team  model  to  the  establishment  of  team  Instructional 
strategies.  For  exa^le.  If  upon  analysis  of  the  team  tasks  there  are 
significant  emergent  requirements,  then  the  instructional  emphasis  should  be 
more  on  developing  problem  solving  and  decision  making  skills  within  the 
individual  team  members  as  opposed  to  training  to  rigidly  structured  responses 
to  given  situations. 

The  Issue  of  team  structure  (serial  vs.  parallel)  also  is  directly 
connected  to  the  development  of  instructional  strategies  via  the  vehicle  of 


the  team  job/  task  and  training  analysis.  Once  the  task  and  Its  situational 
context  Is  Identified,  a last  requirement  of  the  job/task  and  training 
analysis  Is  to  Identify  how  the  team  Is  structured  In  the  performance  of  the 
task.  In  team  operations,  there  will  seldom  be  a purely  serial  or  parallel 
operation.  The  likely  case  for  the  team  operation  Is  that  It  Is  a condilna- 
tlon  of  serial  and  parallel  structured  events.  Therefore,  the  team  job/task 
and  training  analysis  should  define  at  what  points  members  are  performing 
the  same  tasks  simultaneously  (parallel  structure)  and  at  what  points  the 
task  performance  Is  a stimulus-response  type  activity  (serial).  In  turn, 
the  Instructional  strategies  for  directing  the  student  through  the  learning 
events  will  reflect  the  specific  training  task  dimension  by  team  structure 
as  well  as  by  situational  context. 


A CONCEPTUAL  FRAMEWORK  FOR  COLT^  INSTRUCTIONAL  STRATEGIES 
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As  stated  earlier,  the  first  Interim  report  contained  the  results  of  a 
review  of  research  literature  related  to  the  problem  of  developing  Instructional 
strategies  for  COLT^.  Additional  bases  for  the  report  were  Interviews  and 
personal  contacts  with  Instructors  currently  operating  In  the  following  team 
training  environments:  U.S.  Army  Field  Artillery  School  (USAFAS),  Ft.  Sill, 
Oklahoma;  Anti-Submarine  Warfare  (ASW)  School,  San  Diego,  California;  A^hlblous 
Base,  San  Diego,  California;  and  Fleet  Combat  Direction  Systems  Training 
Center,  San  Diego,  California. 

The  analysis  of  the  data  led  to  two  major  conclusions.  The  first  wets 
that  a conceptual  framework  for  a general  purpose  set  of  Instructional 
strategies  for  team  training  does  not  exist.  The  second  conclusion  was  that 
an  ISD  approach  to  team  training  has  not  evolved.  The  two  conclusions  are 
not  mutually  exclusive.  A conceptual  framework  for  team  Instructional 
strategies  must  In  part  rest  on  a team  ISD  approach  for  extracting  the  team 
training  tasks,  establishing  student  attributes  and  learner  strategies,  and 
Identifying  delivery  system  capabilities  and  matching  them  with  tasks  and 
students. 

Thus,  a primary  thrust  of  the  Task  1 study  was  to  define  Instructional 
strategies  within  a conceptual  framework  which  was  responsive  to  elements 
developed  during  a team  ISD  process.  Specifically,  the  report  addressed  the 
derivation  of  Instructional  strategies  for  COLT^  by  three  elements:  team 
training  task  dimensions.  Individual  learner  characteristics  and  strategies, 
and  CAI  system  capabilities.  The  remainder  of  this  section  contains  a 
discussion  of  Instructional  strategies  based  on  the  Task  1 findings.  The 
focus  of  the  discussion  Is  on  the  three  major  elements  comprising  a team 
Instructional  strategy  and  what  prior  research  findings  are  applicable  to 
team  training  questions. 
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Instructional  Strategies 

The  phrase  Instructional  strategies  was  first  described  in  1961  by 
Stolurow  as  the  logical  flow  of  the  instruction  with  consideration  for 
branching  structures  for  correcting  error  responses  or  applying  remediation. 
The  concept  of  instructional  strategies  thus  has  been  with  us  for  more  than 
fifteen  years.  More  recently  it  has  been  subsumed  as  an  integral  component 
by  the  systems  approach  to  curriculum  design  and  development.  However,  as 
pointed  out  by  Cropper  (1974) , while  the  literature  on  instructional  design 
has  grown  rapidly  over  the  last  several  years,  the  formulation  of  instruct- 
ional strategies  has  received  little  systematic  description  in  most  ISD 
models.  Definitions  of  what  is  meant  by  instructional  strategies  are  not 
usually  comprehensive  or  operational.  Cropper  uses  the  term  instructional 
strategies  to  refer  to  prescriptive  rules  for  designing  instructional  events 
which  create  learning  experiences  appropriate  for  the  mastery  of  behavioral 
objectives.  According  to  this  definition,  the  emphasis  must  be  placed  on 
the  properties  of  behavior  to  which  the  instructional  events  must  be  respon- 
sive and  then  on  the  properties  of  the  instructional  events  which  make  them 
responsive. 

The  documentation  for  interservlce  ISD  procedures  does  not  specifically 
use  the  phrase  instructional  strategies.  However,  the  ISD  components  which 
are  defined  do  contain  the  same  elements  of  instructional  strategies  as 
defined  by  Cropper.  After  Job/task  analysis,  selection  of  instructional 
setting,  definition  of  objectives,  and  test  development,  the  instructional 
sequence  and  structure  is  determined  with  specified  learning  events  and 
activities.  Thus,  as  with  Cropper's  definition,  the  strategies  for  meeting 
the  required  objectives  consist  of  activities  for  sequencing,  structuring, 
and  specifying  learning  events /activities.  More  specifically,  instructional 
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strategies,  as  defined  by  Hansen  (1970),  are  the  product  of  a series  of 
decisions  which  provide  for  structuring  the  Instruction  by  such  variables  as 
media  choice,  content,  pacing,  level  of  difficulty,  reading  level,  or  feedback. 


In  developing  the  conceptual  framework  for  deriving  team  training 
strategies.  It  was  concluded  that  these  decisions  ara  based  upon  three  types 
of  Information:  the  characteristics  of  (1)  the  task  to  be  learned;  (2)  the 
learner;  and  (3)  the  delivery  system  for  Instruction.  In  other  words,  COLT^ 
Instructional  strategies  are  derived  on  the  basis  of  task  dimensions,  learner 
characteristics/strategies,  and  CAI  capabilities. 

Team  Task  Dimensions 

A number  of  team  task  dimensions  were  Identified  In  the  literature  and 
through  the  personal  contacts.  From  these  dimensions,  three  categories  of 
team  learning  were  developed  to  serve  as  a link  between  team  Job/task  analysis, 
team  training  objectives,  and  team  instructional  strategies.  Descriptions  of 
these  categories  are  contained  In  the  following  paragraphs. 

Knowledge  of  Team  Roles.  Central  to  a team  effort  Is  the  understanding 
by  each  team  member  of  the  roles — authority,  responsibility,  and  duties — of 
other  team  members.  Moreover,  knowledge  of  team  roles  Includes  being  able 
to  assess  the  capacity  of  oneself  and  other  team  members  to  fulfill  the 
prescribed  roles.  Two  skills,  self-evaluation  aud  ream  awareness,  were 
identified  within  this  category. 

Self -evaluative  skills  are  Important  In  team  training  because  an  effective 
team  member  must  learn  to  determine  when  an  overload  point  has  been  reached 
and  assistance  Is  required  from  another  team  member  (Boguslaw  and  Porter, 

1962).  This  skill  requires  the  analysis  of  one's  own  errors  as  well  as 
knowledge  of  other  members'  loads  such  that  determination  of  reduction  of 
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load  by  another  member  can.  occur.  Self-evaluation  Is  related  to  the  definitions 
of  well-defined,  assigned  team  roles  and  team  goals  because  evaluation 
cannot  occur  without  these  criteria. 

Team  awareness  (Kanarlck,  Alden  and  Daniels,  1972)  centers  on  the 
knowledge  of  a team  member  about  the  roles  of  each  team  Individual  In  relation- 
ship to  the  need  for  effective  communication  and  Interaction.  That  Is,  team 
awareness,  as  a task  dimension.  Is  related  to  the  criteria  of  assigned  roles 
which  are  formal  and  structured. 

Team  Attitudes.  The  terms  confidence,  aggressiveness,  and  pride  were 
not  addressed  In  the  research  literature.  However,  these  attitudes  and 
their  manifestation  In  team-related  behavior  were  emphasized  by  the  team 
trainers  who  were  Interviewed.  The  Instructors  Indicated  that  a team  member 
must  learn  confidence  In  his  abilities  as  an  Individual  and  then  learn 
aggressiveness  In  his  coordination  as  a team  member.  The  dimension  of  pride 
also  entered  Into  these  discussions.  Statements  from  Instructors  Indicated 
that  teams  must  be  trained  toward  specific  team  goals  or  a mission,  and 
pride  Is  a critical  dimension  to  be  addressed  In  the  training.  Most  Importantly, 
team  pride  must  be  related  to  the  achievement  of  a team  goal. 

Team  Communication.  While  communication  Is  discussed  as  a coordination 
task  for  teams,  generally  the  research  and  theory  does  not  Immediately  allow 
for  derivation  of  team  communication  definitions  or  strategies  for  teaching. 
However,  two  studies  demonstrate  that  communication  Is  an  Important  part  of 
a coordination  task  and  training  of  such  coordination  skills  develops  more 
effective  performance  In  a team.  Johnston  (1966) , studying  two  person  teams 
In  a simulated  radar  situation,  compared  coordination  skill  training  to 
Individual  training  with  a criterion  task  requiring  communication.  The 
findings  Indicate  that  performance  was  more  effective  when  the  coordination 


skill  training  was  given.  In  another  condition,  verbal  communication  was 
not  required  and,  as  might  be  expected,  the  coordination  training  was  not 
effective  in  final  performance. 


Willigea  (1966)  found  that  when  two  channels  of  communication,  verbal 
and  visual,  were  allowed,  the  verbal  communication  training  had  no  effect  on 
team  performance.  Federman  and  Siegel  (1965)  found  that  the  transmission 
quality  of  the  primary  sensing  data  had  a deciding  Influence  on  team  perfor- 
mance for  both  communications  and  decisions.  These  two  studies  indicated 
' that  the  team  job/task  analysis  should  have  some  focus  on  determining  communi- 

cation channels  and  the  quality  of  the  channels. 

A study  which  provides  some  clues  to  types  of  team  communication, 
especially  as  applied  to  coordinated  tasks,  was  performed  by  Federman  and 
Siegel  (1965) . This  study  investigated  the  relationship  between  anti- 
submarine warfare  helicopter  team  performance  and  the  content  and  flow  of 
comnunlcatlons  within  the  team  during  an  attack.  Fourteen  different  communi- 
cation variables  were  found  to  be  correlated  with  an  objective  performance 
measurement  criterion  (miss  distance) . A factor  analysis  of  the  fourteen 
communication  variables  resulted  in  four  factors  being  identified:  (1) 
probabilistic  structure,  (2)  evaluative  Interchange,  (3)  hypothesis  formula- 
tion, and  (4)  leadership  control. 

The  factors  defined  by  these  fourteen  variables  demonstrate  the  close 
relationship  between  communications  and  decision  processing.  As  defined  by 
the  authors  of  the  study. 

Probabilistic  structure  is  marked  by  situations  in  which 
extrapolations  contain  the  thought  processes  Involved  in 
weighing  alternatives,  and  in  questioning  and  searching  for 
answers  to  questions.  Evaluative  interchange  is  contained 
in  communications  in  which  there  are  direct  requests  for 
information  and  opinion,  as  well  as  the  responses  to  these 
requests.  Hypothesis  formulation  categorizes  those  communi- 
cations involving  interpretations  of  past  performance  in  the 
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mission  and  evaluation  of  future  tactics  to  be  followed. 

Leadership  control  describes  communication  marked  by  a role- 
assuming  attitude;  It  serves  to  define  goals  and  set  assump- 
tions for  decision  making. 

While  the  study  does  not  directly  address  training  for  these  types  of 
communication-oriented  coordination  tasks,  the  results  suggested  that  the 
four  correlated  communications  variables  are  team  task  dimensions  which 
should  be  Identified  by  a job/task  analysis. 

Sumnary.  The  review  of  the  literature  described  In  the  first  Interim 
report  provided  a framework  for  analyzing  TACFIRE  team  tasks  and  for  deriving 
team  training  objectives  from  the  job/task  analysis.  This  framework  Is  com- 
prised of  the  three  learning  categories  and  their  specific  task  dimensions 
as  shown  In  Table  1. 


Table  1.  Team  Learning  Categories  and  Task  Dlmensons. 


Learning  Category 

Task  Dimension 

(1) 

Knowledge  of  Team  Roles 

a. 

Self-Evaluation 

b. 

Team  Awareness 

(2) 

Team  Attitudes 

a. 

Confidence 

b. 

Pride 

Ce 

Aggressiveness 

(3) 

Team  Communication 

a. 

Probabilistic  Structure 

b. 

Evaluative  Interchange 

c. 

Hypothesis  Formulation 

d. 

Leadership  Control 

Individual  Learner  Characteristics 

For  the  purpose  of  Illustrating  the  relevance  of  student  characteristics 
to  COLT^,  emphasis  will  be  given  to  characteristics  which  may  Impact  on  the 
ability  of  the  student  to  process  Information,  communicate,  make  decisions 
and  solve  problems  In  a coordinated  task  environment.  In  this  way  a model 
of  the  learner  will  be  tied  to  a model  of  the  subject  matter  and  allow 
derivation  of  COLT^  strategies. 
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Learner  characteristics  may  be  used  as  a basis  for  a COLT^  strategy 
with  preprogransied  decisions  or  for  teaching  the  learner  strategies  to  use 
during  COLT^.  To  some  extent,  consideration  of  state  characteristics,  such 
as  the  score  on  the  last  test  or  the  current  state  of  anxiety,  departs  from 
the  concept  of  entry  behavior  description  because  the  measures  may  be  used 
as  dynamic  Indicators  of  a learner  state.  However,  the  discussion,  to  be 
relevant  to  COLT^,  must  allow  both  for  analysis  of  learner  characteristics 
which  will  be  used  In  designing  Instructional  strategies  and  those  which 
will  be  used  during  the  Instructional  manipulation  In  a real-time,  dynamic. 
Interactive  mode. 

Dansereau,  Actklnson,  Long  and  McDonald,  (1974),  Identified  the  following 
factors  which  potentially  affect  a learner's  choice  of  strategies.  Many  of 
the  same  characteristics  have  been  used  In  CAI  strategies  for  selecting 
content,  sequencing,  and  pacing.  These  factors  are  Intellectual  aptitude 
and  the  availability  of  strategy  skills,  personality  variables,  cognitive 
style,  reception  preferences,  motivation,  sex,  and  prior  knowledge.  The 
research  on  each  of  these  factors  Is  too  extensive  and  diverse  for  even  a 
brief  sunmarlzatlon  to  be  Included  In  this  document,  but  examples  of  some 
salient  findings  will  be  discussed.  The  purpose  In  discussing  these  examples 
of  learner  characteristics  Is  to  demonstrate  how  the  general  literature  may 
be  used  to  generate  hypotheses  concerning  learner  characteristics  and  COLT^ 
strategies  within  the  conceptual  framework  presented  here.  The  hypotheses 
will  have  to  be  answered  enqilrlcally. 

Intellectual  Aptitude  and  Availability  of  Strategy  Skills.  Several 
examples  that  relate  the  learner  characteristic  of  Intellectual  skills  to 
the  categories  of  team  learning  discussed  earlier  are  provided.  Conceptual 
complexity,  the  capacity  to  Integrate  and  Interrelate  dimensional  units  of 
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Information,  Is  an  Intellectual  aptitude  that  can  be  measured  (Schroder, 

Driver  and  Steufert,  1967)  and  that  appears  to  be  an  Important  factor  In 
determining  the  types  of  learner  strategies  upon  which  an  Individual  can 
call.  The  characteristic  might  be  considered  for  training  team  members  to 
Integrate  Information  about  team  member  roles  In  relation  to  the  team  goal. 
Research  suggests  that  conceptual  coiq>lexlty  can  be  manipulated  through 
training  (Sleber  and  Lanzetta,  1966). 

Dansereau,  et  al.  (1974)  employed  the  Structure  of  the  Intellect  Model 
(Guilford  and  Hoepfner,  1971)  as  a framework  for  discussing  the  availability 
of  learner  strategy  skills.  In  the  model,  the  following  five  Intellectual 
operations  have  been  Identified  by  factor  analysis  of  a large  variety  of 
paper  ^uld  pencil  tasks: 

(1)  Cognition  - Immediate  discovery,  awareness,  rediscovery,  or  recognition 
of  Information  In  Its  various  forms,  comprehension  or  understanding. 

(2)  Memory  - Fixation  and  retrieval  of  Information  In  storage. 

(3)  Divergent  Production  - Generation  of  logical  alternatives  from 
given  Information,  where  emphasis  Is  upon  variety  and  quantity. 

(4)  Convergent  Production  - Generation  of  logical  conclusion  from 
given  Information,  where  emphasis  Is  upon  achieving  unique  or  conversa- 
tionally best  outcomes. 

(5)  Evaluation  - Conparlsons  of  Items  of  Information  In  terms  of 
variables  and  making  Judgments  concerning  criterion  satisfaction. 

Research  Indicates  that  the  ability  to  perform  these  operations  strongly 
relates  to  achievement  (Guilford,  Hoepfner  and  Petersen,  1965;  Dunham,  Guilford 
and  Hoepfner,  1968;  Caldwell,  Schroder,  Michael  and  Meyers,  1970).  The 
structure  of  Intellect  operations  may  correspond  to  the  basic  skill  components 
required  for  the  development  and  Implementation  of  learner  strategies.  For 
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this  reason,  the  Intellectual  operations  correspond  with  the  categories  of  , 

learner  strategies  developed  In  a subsequent  section  of  this  report.  These 
characteristics  offer  face  validity  as  relevant  to  a team  member's  ability 

to  process  the  Information  communications  In  either  a man-man  or  man-computer-  * ; 

man  situation. 

t 

Personality  Variables.  Three  exaiiq>les  are  provided  to  Illustrate  the 
Influence  personality  variables  may  have  on  team  performance.  Dogmatism  and 
tolerance  of  ambiguity  primarily  Influence  strategy  selection  In  tasks 
Involving  the  manipulation  of  ambiguous  or  belief  discrepant  Information 
(Rokeach,  1960;  Feather,  1964).  The  characteristics  could  be  useful  for 
communication  training  Involving  risk  willingness  or  reluctance  as  defined 
by  Federman  and  Siegel  (1965)  and  discussed  earlier  In  the  section  on  team 
dimensions. 

A measure  of  the  personality  construct,  locus  of  control,  was  developed 
by  Rotter  (1966) . The  construct  itself  Is  viewed  as  a generalized  expectancy 
about  control  over  the  environment  with  a wide  variety  of  situations  Included 
within  the  spectrum  of  generalization.  Internal  control  refers  to  the 
Individual's  belief  that  an  event  Is  contingent  on  his/her  own  behavior  or 
characteristics.  On  the  other  hand,  an  Individual  characterized  by  external 
control  attributes  the  occurrence  of  a significant  event  to  fate,  luck,  or 
to  the  control  of  others  or  as  being  unpredictable  (Rotter,  1966).  Judd, 

O'Neil  and  Spelt  (1974)  conducted  an  extensive  review  of  the  research  that 
has  appeared  since  Rotter's  Initial  formulation.  The  research  Indicates 
that  the  external  subject  requires  more  specific  guidelines  than  the  Internal 
subject  In  order  to  perceive  his  own  needs  and  take  the  opportunity  to 
control.  It  also  appears  that  Increasingly  well-defined  task  Instructions 

provide  a missing  cognitive  link  for  external  subjects  which  helps  them  to  : 
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Improve  their  performance.  The  locus  of  control  characteristic  may  assist, 
therefore,  in  defining  instructional  strategies  for  adapting  the  feedback 
and  prompting  to  team  members  during  COLT^  communications — especially  those 
associated  with  decision  processing. 

Cognitive  Styles.  Dansereau,  et  al.,  (1974)  discuss  cognitive  style 
as  a characteristic  which  creates  boundaries  on  the  types  of  learner  strategies 
available  to  Individuals.  Cognitive  styles  are  considered  to  be  preferences 
in  perceptual  organizing  and  conceptual  categorizing  of  the  environment.  A 
number  of  specific  cognitive  styles  have  been  identified.  While  we  will  not 
attempt  to  go  into  the  specific  investigations  of  the  relationship  between 
cognitive  style  variables  and  performance,  it  should  be  noted  that  there  are 
indications  that  cognitive  styles  are  a variable  to  be  considered  in  the 
development  of  adaptive  instructional  methods  which  match  media  or  level  of 
difficulty  to  the  learner's  style.  The  applicability  of  cognitive  style 
characteristics  to  COLT^  is  presented  with  one  example. 

Cognitive  style  tests,  named  field  dependence/fleld  Independence  (Witkln, 
Lewis,  Hertzman,  Machover,  Meissner  and  Wapner,  1954),  measure  the  ability 
to  Isolate  and  process  simple  information  from  a more  complex  informational 
environment.  The  tests  use  geometric  figures  but  seem  to  have  correlation 
with  a variety  of  real  tasks.  Kennedy  (1972)  found  field  dependence  to  be 
related  to  success  in  aviation  training.  The  characteristic  may  have 
applicability  to  the  communication  training  required  for  Interaction  between 
the  artillery  control  console  operator  and  fire  direction  officer  in  TACFIRE. 
Each  has  a separate  display  of  complex  Information  and  each  must  Isolate 
Information  from  it.  The  operator  must  isolate  and  pass  information  to  the 
officer  and  the  officer  must  make  a decision  based  on  that  information  and 
his  own  and  then  pass  back  an  order  to  the  operator. 
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Reception  Preferences.  Research  has  Indicated  that  individuals  have  | 

preferences  for  receiving  Infomatlon  in  certain  ways  (Hartnett,  1973).  As  | 

with  menitlvo  stvles,  these  preferences  can  Influence  the  strategies  avail-  j 

j 

able  to  a student  and  the  effectiveness  of  the  application  of  an  instructional 
strategy.  Reception  preference  characteristics  may  be  related  to  communica- 
tion training.  For  example,  Wllleges  (1966)  found  that  when  two  channels  of 
communication,  verbal  and  visual,  were  used  in  a team,  verbal  communication 
training  had  no  effect.  Reception  preference  may  be  the  reason  for  students 
using  only  the  visual  channel  and  not  the  verbal  channel  available  to  them. 

Motivation,  Sex,  and  Prior  Knowledge.  It  should  also  be  noted  that 
there  are  a number  of  other  individual  difference  variables  that  could 
potentially  Influence  the  selection  and  utilization  of  particular  learner 
strategies  during  COLT^.  Any  comprehensive  attempt  to  identify  these  variables 
and  to  take  them  into  account  for  COLT^  instructional  strategies  would  have 
to  include  the  motivation,  sex  and  prior  knowledge  of  the  subjects  involved 
in  the  Instruction.  Each  of  these  variables  has  proven  to  be  significantly 
related  to  learning  outcomes. 

Summary.  The  above  subsections  provide  examples  of  student  entry 
characteristics  which  may  impact  on  the  design  and  manipulation  of  learning 
events.  The  categories  of  learner  characteristics  Include  (1)  Intellectual 
aptitude  and  availability  of  strategy  skills;  (2)  personality  variables; 

(3)  cognitive  styles;  (4)  reception  preferences;  and  (5)  motivation,  sex, 
and  prior  knowledge.  The  research  behind  the  variables  presented  indicates 
that  frequently  significant  differences  in  performance  and  achievement  are 
attributable  to  the  individual's  composite  of  values  related  to  these  variables. 

Learner  characteristics,  in  turn,  may  serve  in  part  as  the  basis  for 
instructional  design — addressing  such  issue  as  content,  sequencing,  pacing, 
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levels  of  difficulty,  or  Instruction  medium.  Within  COLT^  Instructional 
strategies,  learner  characteristics  also  may  serve  as  the  basis  for  the 
real-time,  dynamic  manipulation  of  both  student  and  learning  events. 

Individual  Learner  Strategies 

The  three  categories  of  learner  strategies  discussed  In  this  section 
were  first  developed  by  DlVesta  (1971)  and  maintained  by  Dansereau  et  al., 
(1974)  In  a report  for  the  U.S.  Air  Force.  The  categories  are  made  up  of 
conq) rehens Ion,  memory,  and  problem  solving  strategies.  The  remainder  of 
this  section  will  deal  with  each  of  these  learner  strategy  categories — 
attempting  to  define  the  parameters  of  each  category  and  providing  a brief 
summarization  of  the  state-of-the-art  for  learner  strategies  Included  within 
each  category.  A series  of  tables  corresponding  to  the  learner  strategy 
categories  Is  Included  In  the  first  Interim  report  for  this  project.  Each 
table  Includes  specific  strategies,  a summary  of  the  research  with  Implications 
for  Instruction,  and  a list  of  references.  The  purpose  of  the  tables  Is  to 
Illustrate  the  current  directions  of  Individual  learner  strategy  research. 

Compr ehens Ion  Strategies.  Comprehension  strategies  relate  to  the 
acquisition  of  cognitive  processes  that  occur  during  learning.  Specifically, 
the  strategies  which  have  received  the  preponderance  of  attention  from 
researchers  are  those  which  attempt  to  explain  how  the  learner  understands. 

As  reviewed  by  Dansereau,  considerable  research  has  been  conducted  for  the 
purpose  of  ascertaining  the  facllltatlve  effects  of  comprehension  strategies 
In  the  Instructional  process.  The  discussion  on  comprehension  strategies 
Incitjdes  coverage  of  the  effects  of  organizational  strategies  (advanced 
organizers,  passage  organization,  and  post  organizers),  the  effect  of  ques- 
tions, notetaking,  rule  presentation,  presentation  of  learning  objectives, 
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Generally,  the  research  dealing  with  comprehension  strategies  has 
progressed  beyond  the  "basic"  stage  and  specific  Implications  for  educational 
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applications  can  either  be  Inferred  or  posited  on  the  basis  of  empirical 
findings.  Many  of  the  comprehension  factors  which  appear  to  have  a substan- 
tial lnq>act  on  student  performance  also  have  Implications  for  the  development 
of  educational  materials.  Furthermore,  the  dimensions  of  conq>rehenslon 
strategies  for  Individuals  appear  to  hold  for  team  training. 

Comprehension  strategies  are  closely  associated  with  team  awareness. 

For  example,  a number  of  researchers  have  demonstrated  that  students  tend  to 
organize  external  stimuli  In  consistent,  systematic  patterns  (Dansereau,  et 
al. , 1974;  Cofer,  1966).  In  turn,  the  preorganization  of  Instructional 
materials  to  correspond  with  those  patterns  has  led  to  more  efficient  learning 
since  the  student  Is  not  as  dependent  on  rational  processes.  In  team  aware- 
ness training,  the  organizational  structuring  of  the  materials  In  terms  of 
content,  sequencing,  and  display  may  be  critical  if  the  desired  learning  is 
to  occur. 

Memory  Strategies.  Atkinson  and  Shlffrln  (1968)  have  argued  for  the 
Importance  of  strategies  In  determining  which  Information  Is  entered  Into 
and  retrieved  from  short-  and  long-term  storage.  These  authors  refer  to 
processes  that  are  not  permanent  features  of  memory,  but  rather  transient 
phenomena  under  the  control  of  the  subject,  as  control  processes.  The 
appearance  of  these  processes  depends  on  such  factors  as  the  Instructional 
set,  the  experimental  task,  and  the  past  history  of  the  subject.  The  purpose 
of  this  section  Is  to  discuss  specific  examples  of  these  control  processes 
as  memory  strategies,  and  If  possible,  to  extend  them  Into  the  Instructional 
domain. 
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Memory  strategies  Include  the  presentation  of  selection  cues,  mnemonic 
techniques,  visual  Imagery,  subjective  organization,  memory  management,  and 
retrieval.  Of  the  learner  strategies  listed,  the  first  three  appear  to  have 
direct  and  positive  Implications  for  Instructional  settings.  Subjective 
organization,  memory  management,  and  retrieval  strategies,  on  the  other 
hand,  have  not  proven,  as  yet,  to  constitute  viable  operational  strategies 
for  the  development  of  Instructional  materials  or  for  the  specification  of 
Instructional  strategies. 

Selection  cues  and  the  use  of  mnemonic  techniques  have  always  been  an 
Integral  part  of  Army  artillery  verbal  communications.  The  TACFIRE  system, 
when  In  a digital  mode,  converts  the  traditional  verbal  messages  Into  visual 
representations  displayed  on  the  TACFIRE  CRT.  Selection  cues  are  reflected 
In  the  message  format  but  no  research  has  been  conducted  to  establish  the 
effectiveness  of  the  present  techniques. 

Problem  Solving  Strategies.  The  third  category  Includes  learner  strategies 
associated  with  problem  solving  techniques.  This  category  can  be  further 
broken  down  Into  learner  strategies  associated  with  problems  which  fall  Into 
two  major  types:  closed-system  problems  and  open-system  problems.  Bartlett 
(1958)  described  closed-system  problems  as  ones  that  are  formed  In  such  a 
way  that  all  the  elements  for  solution  are  available  and  the  problem  solver 
has  to  fill  In  the  appropriate  element.  In  essence,  closed-system  problems 
are  characterized  by  the  existence  of  an  Identifiable  solution  and  further, 
progress  toward  this  solution  Is  usually  also  Identifiable.  Examples  of 
closed-system  problems  would  Include  anagrams,  chess,  logic,  math  problems, 
concept  formation,  equipment  repair  (troubleshooting),  navigational  problems, 
etc. 
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In  open-system  problems  the  problem  solver  must  go  beyond  the  units 
Inmedlately  given  In  order  to  discover  a solution.  Neither  the  solutions 
nor  the  progress  towards  solutions  are  readily  Identifiable.  Examples  of 
open-system  problems  Include  determining  unusual  uses  for  common  objects, 
creating  cartoon  captions  and  movie  titles.  Inventing  a new  device  or  product, 
writing  a term  paper,  etc. 

In  closed-system  problem  solving  three  distinct  approaches  have  been 
Investigated:  (1)  partlst  strategies;  (2)  whollst  strategies;  and  (3) 
heuristics.  Although  only  limited  research  has  been  conducted  on  each  of 
these  closed-system  problem  solving  strategies,  and  research  findings  on  the 
subject  are  not  particularly  substantial,  there  are  implications  for  Instruc- 
tional processes  associated  with  each  strategy. 

A good  example  of  how  problem  solving  Is  related  to  team  Instructional 
strategies  is  a "brainstorming"  session.  Members  of  a "brainstorming"  group 
confront  open-system  problems  on  a team  basis — each  Individual  contributing 
Ideas  yet  building,  whole  or  In  part,  on  the  contributions  of  the  other 
members.  A Delphi  exercise  is  another  example  of  team  open-system  problem 
solving. 

To  Illustrate  team  closed-system  problem  solving,  an  excellent  example 
can  be  taken  from  Army  artillery  procedures.  The  most  Important  problem 
faced  by  artillery  personnel  Is  how  to  accurately  and  effectively  fire  a 
round  at  an  enemy.  In  order  to  resolve  the  problem,  a number  of  Individuals 
must  coordinate  Information  and  actions. 

Summary.  Individual  learner  strategy  categories  are  made  up  of 
coiiq>  rehens  ion,  memory,  and  problem  solving  strategies.  Comprehension 
strategies  relate  to  the  cognitive  processes  underlying  Individual  learning. 
Included  are  Instructional  organization,  the  effect  of  questions,  notetaking. 
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rule  presentation,  presentation  of  learning  objectives,  and  reading  flexibility. 
Memory  strategies  relate  to  the  entry  and  retrieval  of  information  from 
short-  and  long-term  storage.  Memory  strategies  Include  the  presentation  of 
selection  cues,  mnemonic  techniques,  visual  Imagery,  subjective  organization, 
memory  management,  and  retrieval.  Finally,  learner  strategies  associated 
with  problem  solving  techniques  are  placed  in  a third  category.  These 
strategies  may  further  be  grouped  as  they  relate  to  either  closed-  or  open- 
system  problems. 

The  analysis  of  the  literature  that  is  related  to  learner  strategies 
indicates  that  a number  of  strategies  have  proven  effective  in  the  design  of 
instructional  materials.  Foremost  among  these  are  material  organization  and 
student  interaction  (comprehension  strategies);  the  use  of  selection  cues, 
mnemonics,  and  visual  imagery  (memory  strategies);  and  training  of  deductive 
and  heuristic  techniques  (problem  solving  strategies).  Moreover,  in  most 
Instances  the  strategies  would  appear  to  hold  for  team  training  environments 
as  well  as  for  the  individual  environments  in  which  they  have  been  Investigated. 

Computer-Assisted  Instruction  Capabilities 

CAT  is  a set  of  programmed  components  for  presenting  information, 
providing  student  interaction,  monitoring  student  progress,  and  manipulating 
the  sequence  of  instruction.  Instructional  strategies  encompassing  CAI  as 
the  delivery  system  are  distinct  only  in  that  they  reflect  the  functional 
capabilities  of  the  hardware  and  software  unique  to  CAI  systems.  The  prime 
purpose  of  this  subsection  is  to  briefly  describe  the  implications  for  COLT^ 
Instructional  strategies  of  CAI  systems  hardware  and  software  and  to  discuss 
how  current  CAI  operational  modes  are  tied  to  COLT^. 

Hardware  and  Software  Capabilities.  A prime  component  of  media  hardware 
for  CAT  la  the  prescnt.ition  device.  Several  different  types  of  visual 
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infomatlon  may  be  presented  depending  on  the  system.  In  some  systems  only 
alphanumeric  text  can  be  displayed,  and  In  others.  It  Is  possible  to  represent 
pictorials  by  graphics.  The  type  and  complexity  of  graphics  may  also  vary. 

For  example,  still  graphics  such  as  diagrams,  graphics  which  have  partial 
movement  only,  or  full  dynamic  graphics  similar  to  animation  may  each  be 
possible  depending  on  the  system.  Some  systems  also  have  the  capability  to 
present  slide  or  microfiche  pictures.  Other  systems  are  capable  of  presenting 
motion  pictures  through  computer-controlled  videotape,  as  exemplified  by 
TICCIT  developed  by  the  MITRE  Corporation  or  the  Navy  Personnel  Research  and 
Development  Center's  Computer  Controlled  Multi-Media  System  (CM) 2s.  The 
use  of  split  screens  or  more  than  one  visual  presentation  monitor  Is  also 
possible,  such  as  the  Computer-Based  Training  System  developed  by  General 
Electric  Ordnance  Systems  or  the  (CM) 2s  system.  As  an  example  of  how  the 
presentation  media  relates  to  COLT^  strategies,  one  review  of  team  training 
(Wagner,  et  al. , 1976)  suggested  the  possibility  of  using  split  screens  to 
present  Information  relevant  to  the  position  being  trained,  as  well  as 
Information  showing  the  trainee  the  status  of  the  coordinating  position. 

Response  devices,  as  part  of  the  media  hardware,  also  Influence  which 
Instructional  strategies  are  possible.  Typical  response  devices  Include 
standard  keyboards,  special  function  keyboards,  graphic  writing  tablets, 
llghtpens,  touch  panels,  voice  recognition  systems,  a device  similar  to  a 
track  ball  called  a mouse,  and  special  adjunct  console  controls.  The  choice 
of  response  device  determines  the  mode  of  Input  during  the  Interaction  of 
student  and  system. 

Because  of  the  nature  of  the  presentation  and  response  devices  In  a 
general  purpose  CAT  system,  questions  of  fidelity  and  transfer  of  learning 
for  many  tasks  Involving  equipment  operator  training  may  arise.  It  should 
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be  recognized  that  CAl  Instructional  strategies,  such  as  student  progress 
diagnosis  In  real-time,  pacing,  adaptive  Instruction,  feedback,  and  optimiza- 
tion, can  be  Included  In  many  real  man-machine  systems  with  greater  fidelity 
available  than  on  general  CAI  systems. 

Similarly,  the  computer  software  available  Influences  Instructional 
strategies.  Just  as  the  current  team  training  version  of  PLAKIT  can  assist 
In  developing  COLT^  Instructional  strategies,  we  may  expect  additional 
software  capabilities  to  provide  for  other  strategies.  Software  capabilities 
required  can  also  be  related  to  computational  capabilities,  such  as  those 
used  In  optimization  or  adaptive  techniques,  and  control  of  media  hardware 
presentation  and  response  devices. 

CAI  Modes.  Table  2 presents  the  names  of  Instructional  strategies 
found  In  the  literature  on  CAI.  It  should  be  noted  that  several  of  these 
names  are  repeated  In  the  various  categorizations  of  Instructional  strategies. 
For  example,  drill  and  practice  and  a tutorial  CAI  are  represented  In  some 
way  In  most  of  the  lists.  Only  Hickey's  (1968)  definitions  are  shown  since 
he  has  summarized  most  of  the  others. 

However,  while  these  names  are  termed  Instructional  strategies,  as  In 
the  case  of  Hickey,  they  are  probably  more  properly  called  modes  of  CAI  In 
that  they  represent  purposes  for  which  CAI  may  be  used  In  the  overall  Instruc- 
tional design.  For  example,  drill  and  practice  may  be  used,  as  described  by 
Suppes  (1969),  to  supplement  the  regular  curriculum  taught  by  a teacher. 

The  Introduction  of  concepts  and  new  Instruction  Is  handled  In  a conventional 
fashion  by  the  teacher,  but  the  computer  takes  the  role  of  providing  review 
and  practice  on  those  concepts  and  new  Instruction.  While  drill  and  practice 
represents  an  Instructional  strategy  In  part,  there  are  many  more  details  to 
consider.  For  example.  In  Che  Stanford  program  on  mathematics  (Suppes,  Jerman 
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Table  2.  Representative  CAI  Modes 


Hickey  (1968) 

( ] ) Tutorial 

(a)  Linear:  straight  line,  non- Individualized  Instruction 

(b)  Intrinsic:  Individualized,  branching  Instruction 

(c)  Adaptive:  Instruction  which  uses  declslon-maklng  models  to  make 

successive  decisions  from  Instructional  alternatives  to 
adapt  the  Instruction  to  the  learner 

(2)  Socratlc:  Tutorial  but  allowing  student  to  assert  an  answer  or  solu- 

tion and  ask  for  Information.  Similar  to  Suppes  Dialogue  mode. 

(3)  Learner  Controlled:  Instruction  allowing  student  to  select  path  of 

events . 

(4)  Simulation:  Instruction  which  duplicates  In  the  learning  situation 

the  format  and  sequence  of  stimulus  events  In  the  real  world. 

(5)  Game:  A form  of  simulation  Involving  situations  of  competition  or 

conflict. 

(6)  Testing:  Testing  Is  viewed  as  an  Instructional  strategy  by  Hickey 

because,  with  CAI,  techniques  may  be  used  encompassing  branching, 
math  models,  decision  theory,  and  other  declslon-maklng  proce- 
dures of  CAI.  The  testing  may  also  be  embedded  In  the  CAI  as 
an  Integral  part. 

Suppes  (1969)  Zlnn  (1967) 


(1) 

Drlll-and-Practlce 

(1) 

Drill 

(2) 

Tutorial 

(2) 

Author  Controlled  Tutorial 

(3) 

Dialogue 

(3) 

Dialogue  Tutorial 

(4) 

Simulating  and  Gaming 

Stolurow  (1969) 

(5) 

Retrieval  and  Reorganization 

(1) 

Problem  Solving 

of  Information 

(2) 

Drlll-and-Practlce 

(6) 

Problem  Solving 

(3) 

Inquiry 

(7) 

Artistic  Design 

(4) 

Simulation  and  Gaming 

(8) 

Composition 

(5) 

Tutorial  Instruction 

Rodgers 

(1967) 

(1) 

Drill 

(2) 

Tutorial 

(3) 

Conver sat lonal 

(4) 

Simulated  Environment 

(5) 

Simulated  Decision 
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and  Brian,  1968),  an  algorithm  was  developed  for  determining  mastery  of 
materials  and  adapting  the  drill  to  a learner's  state.  Algorithms  of  this 
sort  can  vary  and,  as  they  vary,  represent  differences  In  the  Instructional 
strategies.  In  fact,  it  Is  one  of  the  benefits  of  CAI  that  such  algorithms 
can  be  performed  In  real-time  with  dynamic  decision  making  about  the  student’s 
learning  state  and  the  Information  to  be  presented. 

The  point  Is  that  the  Instructional  strategies  represented  In  Table  2 
are  actually  overall  purposes  which  are  probably  better  termed  modes. 
Instructional  strategies  per  se  are  more  appropriately  considered  to  be 
combinations  of  the  CAI  modes,  the  media  characteristics,  the  algorithms 
used  as  a function  of  the  software  available,  the  components  of  the  Instruc- 
tional setting  which  are  adjunct  to  the  computing  system,  and  other  factors. 

Finally,  while  the  modes  of  CAI  described  above  denote  the  general 
characterization  of  instructional  strategies  in  a computer-based  system, 
they  do  not  specifically  delineate  the  techniques  used  to  achieve  the  goals 
(direct  Instruction,  drill,  etc.).  The  decisions  In  specifying  COLT^ 
Instructional  strategies  are  many  and  Include  content,  amount  and  type  of 
student  control,  media  selection  for  presentation  and  Interaction,  difficulty 
levels,  adjunct  materials,  and  pacing.  In  short,  the  decisions  are  based  on 
Information  from  each  of  the  conceptual  framework  categories  that  have  been 
established.  The  distinct  advantage  of  COLT^  over  other  instructional  media 
forms  Is  CAI  can  Incorporate  measurement  and  coiiq>utatlonal  techniques  that 
can  more  fully  Integrate  these  dimensions  and  allow  for  more  Individually 
oriented  strategies. 

The  measurement  techniques  used  In  CAI  are  in  fact  part  of  the  Instructional 
strategies  since  many  of  the  presentation  variables,  response  modes,  and 
sequencing  techniques,  as  well  as  student  evaluation,  depend  heavily  on  the 
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measuring  techniques  used  (Hansen  and  Johnson,  1971) . In  adaptive  Instruction, 
for  example,  preliminary  measures  such  as  scores  on  personality  scales, 
achievement  scales,  and  aptitude  scales  may  be  used  In  regression  models 
(Rivers,  1972;  Suppes,  Fletcher  and  Zanottl,  1973a,  1973b).  These  student 
characteristics.  Including  measures  of  learner  strategies,  are  also  the 
basis  for  many  of  the  decisions  In  CAI  Instructional  strategies,  both  pre- 
Instructlon  and  within  Instruction.  Besides  these  measures,  within  Instruc- 
tion measures  are  usually  In  two  forms:  (1)  the  criterion  examination,  and 
(2)  response  latencies.  Another  type  of  measure  sometimes  used  Is  error 
rate.  Several  Items  of  Importance  for  measurement  strategies  In  COLT^  may 
be  noted  at  this  point.  First,  as  pointed  out  by  Faust  (1976),  very  little 
has  been  done  In  measuring  team  learning  progress  within  Instruction. 

Usually  only  a final  criterion  measure  Is  used  to  measure  team  effectiveness. 
Along  these  lines  also,  little  has  been  done  to  measure  specific  team  task 
dimensions  other  than  communications  variables.  Secondly,  measures  of  team 
performance  do  not  usually  have  well-defined  conditions  for  the  role  and 
specific  behavior  of  each  Individual  In  relation  to  the  team  goal. 

Summary.  The  primary  CAI  capabilities  which  Impact  on  COLT^  Instructional 
strategies  may  be  grouped  Into  hardware  and  software  categories.  Hardware 
capabilities  essentially  reflect  presentation  and  response  devices.  In 
turn,  the  characteristics  of  both  devices  are  delimiters  of  the  Interaction 
between  students  and  system.  Software  capabilities  underlie  the  CAI  modes 
available  to  a lesson  author  and,  thus,  also  are  a factor  to  be  accounted 
' for  In  the  Instructional  strategy.  Examples  of  CAI  modes  Include  drill, 

tutorial,  learner  controlled,  simulation,  game,  and  testing.  Further,  C0Lt2 
Instructional  strategies  are  based  In  part  on  the  capability  of  the  language 
system  to  provide  coordinating  functions  among  team  members. 
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A third  consideration  In  COLT^  Instructional  strategies  Is  the  measurement 
technique  employed  In  the  CAI.  Many  of  the  presentation  variables,  response 
modes,  lesson  sequencing,  and  student  manipulation  depend  heavily  on  what 
Information  In  regard  to  student  characteristics  and  performance  and  what 
capability  exists  to  analyze  the  data.  These  measures  are  the  basis  for 
many  COLT^  Instructional  strategy  decisions,  both  pre  and  within  Instruction. 

Implications  for  Developing  Team  Instructional  Strategies 

As  defined  by  Hansen  (1970) , an  instructional  strategy  Is  a series  of 
decision  points  which  lead  to  the  sequencing,  structuring  and  specifying  of 
learning  events  and  activities.  Variables  such  as  media  choice,  content, 
pacing,  level  of  difficulty,  and  feedback  are  examples  of_  outputs  from  the 
decision  making.  Information  underlying  these  decisions  Is  based  on  the 
characteristics  of  (1)  the  task  to  be  learned,  (2)  the  learner,  and  (3)  the 
Instructional  delivery  system.  In  turn,  team  Instructional  strategies  must 
account  for  the  variables  representing  each  of  these  dimensions  within  a 
context  typically  requiring  multiperson  Interactions.  The  coordinating  and 
cooperative  behavior  present  In  the  job  must  also  be  present  In  the  training. 

The  first  step  In  developing  team  Instructional  strategies  Is  to  Identify 
the  team  tasks.  Team  tasks  are  defined  by  the  task  dimensions  previously 
discussed  and  their  parameters  set  by  the  task  situation  (established  to 
emergent)  and  by  the  Intra-team  member  structure  (serial  or  parallel)  typically 
established  for  achieving  the  task.  A clear  delineation  of  tasks  by  content, 
situation,  and  team  structure  Is  critical  to  developing  effective  team 
Instructional  strategies. 

Specifically,  the  team  Instructional  strategy  must  represent  the  job/tasks 
by  the  team  requirements  which  go  beyond  the  Individual  technical  proficiency 
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requirements.  For  exaiiq>le,  team  operations  are  enhanced  by  a thorough 
understanding  by  each  team  member  of  the  roles — authority,  responsibility, 
and  duties — of  other  team  members  and  how  one's  own  role  couples  with  the 
roles  of  other  team  mciid>ers.  Knowledge  of  team  roles  Is  Important  when  the 
team  functions  In  serial  and  In  parallel  and  In  both  established  and  emergent 
situations.  Further,  effective  teams  are  frequently  characterized  by  compen- 
satory behavior;  that  is,  one  or  more  team  members  perform  tasks  which  are 
not  typically  defined  as  their  responsibility.  The  bases  for  coiiq>ensatory 
behavior  are  numerous  (e.g..  Individual  weakness,  situational  task  overload, 
equipment  outages,  etc.).  What  Is  critical  Is  that  team  members  recognize 
potential  catastrophic  situations,  make  correct  judgments  as  to  how  they  can 
contribute  to  the  correcting  of  a team  "malfunction,"  and  take  corrective 
actions.  Each  of  these  steps  is  dependent  on  team  members  having  the  skills 
to  evaluate  their  own  as  well  as  other  team  members'  performance. 

Other  facets  of  knowledge  of  team  roles  Include  error  recognition  and 
analysis,  formulation  of  Intra-team  feedback,  and  reception  and  evaluation 
of  feedback  messages.  Indlvldtial  technical  proficiency  underlies  each  of 
these  facets.  However,  team  training  focuses  on  teaching  the  Individual  how 
to  optimally  apply  his  skills  and  knowledge  within  a dynamic  team  environment. 

In  addition  to  knowledge  of  team  roles,  team  attitudes  and  team  communication 
are  task  dimensions  which  must  be  addressed  by  team  Instructional  strategies. 

Second,  decisions  regarding  the  structuring  and  sequencing  of  learning 
events  must  incorporate  attributes,  aptitudes,  and  strategies  related  to  the 
Individual  learners  who  will  comprise  the  operational  team.  Prior  research 
on  learner  characteristics  and  strategies  has  primarily  dealt  with  the 
Individual  learner  working  on  single  person  tasks.  Thus,  as  a general 
statement.  It  can  be  said  that  further  Investigation  should  center  on  the 
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relationships  among  such  variables  as  team  personality  complexion,  cognitive 
styles,  reception  preferences,  motivation,  sex,  and  prior  knowledge  as 
factors  which  effect  team  Information  processing,  communications,  decision 
making,  problem  solving  and  task  achievement.  The  desired  outcome  of  a 
program  of  research  would  be  a model  of  team  composites  and  learner  strategies 
which  could  be  matched  with  specific  team  training  task  requirements. 

In  the  Interest  of  the  present  project  and  current  team  training  efforts, 
those  learner  characteristics  and  strategies  which  appear  to  hold  for  team 
training  are  Important.  Among  these  are  selected  comprehension,  memory, 
problem-solving  and  feedback  strategies.  The  applicability  of  each  to  team 
training  has  been  discussed  In  prior  subsections.  It  seems  appropriate, 
however,  to  provide  a synopsis. 

Coiq>rehenslon  strategies  are  based  on  the  cognitive  processes  which 
occur  during  learning.  They  are  manifested  In  training  through  the  organlza- 

I tlon  of  Instructional  materials,  student  Interactions,  and  the  types  and 

■ 

level  of  materials  presented  to  the  student  (l.e.,  objectives,  rules,  reading 
flexibility,  etc.). 

There  Is  no  reason  to  believe  that  comprehension  strategies  are  less 

r 

Important  to  team  training  than  to  Individual  training.  On  the  contrary, 

■ 

they  may  be  more  critical.  For  example,  student  Interaction  strategies  are 
primarily  concerned  with  the  Interface  of  student  and  material  (e.g.,  effect 
of  questions,  notetaking.  Instructional  prescriptions).  In  team  training 
the  student/student  interface,  as  representative  of  team  member  Interaction, 

Is  an  added  critical  dimension. 

Memory  strategies  relate  to  the  entry  and  retrieval  of  Information  from 
short  and  long  term  memory  storage.  Specific  strategies  related  to  this 
process  Include  the  presentation  of  selection  cues,  mnemonic  techniques. 
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visual  Imagery,  subjective  organization,  memory  management  and  retrieval.  As 
stated  previously,  the  first  three  strategies  have  the  greatest  Immediate 
Implications  for  training  and  the  development  of  team  Instructional  strategies. 

In  the  development  of  the  brassboard  materials,  selection  cues  were  used 
extensively.  The  cues  were  based  on  the  priority  and  Importance  of  the  Infor- 
mation presented  in  terms  of  task  achievement.  In  addition,  a form  of  mnemonics 
was  employed  to  represent  team  communications.  Finally,  visual  Imagery  was 
stimulated.  The  project  team  considered  this  strategy  to  be  critical  to 
retention  of  the  materials  (rules)  to  be  learned  and  to  the  enhancement  of 
learner  attitudes  and  motivation. 

Selected  closed-system  problem  solving  strategies  are  applicable  to 
military  team  training  problems  and  could  effectively  be  represented  In 
learning  events.  For  example,  TACFIRE  operations  at  the  Battalion  Fire  Direction 
Center  require  a dynamic  interplay  of  partlst  and  whollst  problem  solving 
techniques.  Partlst  strategies.  In  the  form  of  reception  paradigms,  are 
appropriate  to  the  analysis  of  TACFIRE  operational  messages.  In  essence,  the 
operator  entertains  positive  Instances  and  selectively  scans  the  message  data 
to  test  and  enlarge  on  the  Instances.  The  hypothesis  related  to  actual 
combat  conditions  Is  derived. 

Whollst  strategies  also  are  integral  to  tactical  problem  solving.  The 
Fire  Direction  Officer  (FDO)  is  taught  tactical  hypotheses  covering  a broad 
range  of  combat  situations  (these  hypotheses  also  are  represented  In  the  fire 
plan).  As  the  battlefield  scenario  unfolds,  the  FDO  constantly  "checks  the 
positive  Instances  (actual  occurrences)  with  his  hypotheses  to  determine  his 
tactical  decisions.  Both  partlst  and  whollst  strategies  are  represented  In 
the  training  scenarios  developed  for  the  brassboard  demonstration/evaluation. 
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Finally,  feedback  strategies  are  proven  effective  In  Individual  training. 
The  most  difficult  aspect  of  Implementing  comprehensive  feedback  strategies  In 
team  training  Is  differentiating  Individual  team  members'  contributions  to  the 
team  effort.  COLT^  offers  the  optimum  solution  to  this  problem  as  each  member 
can  be  monitored  online  simultaneously  to  the  total  team  evaluation  and  feed- 
back. A second  major  team  feedback  Issue  has  not  been  addressed.  That  Is, 

In  most  team  operations  there  Is  a 'process'  paradigm  which  yields  most  reliable 
results.  Therefore,  both  process  and  product  evaluation  models  need  to  be 
developed  In  order  to  more  uniformly  train  to  team  activities.  Such  a process 
model  would  have  the  capacity  for  providing  corrective  feedback. 

In  summary,  there  are  a number  of  learning  strategies  which  currently 
should  be  considered  as  part  of  the  data  base  from  which  team  training  Is 
developed.  Notably  excepted  from  this  group,  however,  are  personality 
variables,  many  of  which  have  served  as  good  predictors  of  performance  and  as 
a basis  for  prescriptive  Instruction.  There  Is  little  research  In  this  area 
from  which  conclusions  regarding  optional  make-up  or  complexion  of  teams  can 
be  drawn. 

Finally,  the  third  dimension  of  the  conceptual  framework  for  devleoplng 
team  Instructional  strategies  encompasses  the  Instructional  delivery  system 
or  Instructional  medium.  For  the  present  study,  the  medium  was  CAl.  The 
COLT^  Instructional  strategies  accounted  for  the  hardware  and  software  capa- 

I 

bllltles  present  In  PLANIT  and  the  operating  system  available.  In  short. 
Instructional  strategies  are  delimited  by  the  medium  through  which  the 
learning  Is  to  occur.  A detailed  description  of  the  potential  of  the  team 
training  version  of  PLANIT  Is  contained  In  the  Discussion  section. 
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DESIGN  AND  IMPLEMENTATION  OF  A TEAM  ISD  MODEL:  BRASSBOARD  DEVELOPMENT 

Overview 

In  developing  the  CAI  "Brassboard" , a team  ISD  approach  was  designed  and 
Implemented.  The  major  coiiq>onents  of  the  approach  Included  job /task  analysis, 
development  of  team  learning  objectives,  and  scenario  development  inclusive  of 
Instructional  strategies.  In  turn,  each  of  the  components  was  developed  in  a 
manner  that  reflected  the  team  training  concepts  and  Issues  that  are  discussed 
in  the  previous  sections.  For  example,  the  job/task  analysis  accounts  for 
team  behaviors  required  for  both  an  established  and  emergent  TACFIRE  environ- 
ment as  well  as  defining  each  task  in  terms  of  either  a parallel  or  serial 

operation.  Further,  the  instructional  strategies  underlying  the  scenarios  are 

* 

based  on  the  team  task  dimensions.  Individual  learner  strategies,  and  PLANIT 
capabilities. 

The  following  subsections  discuss  the  ISD  procedures  involved  in  develop- 
ing the  brassboard  and  describe  the  materials  developed. 

Selection  of  TACFIRE  Fxmctlonal  Area  to  be  Analyzed 

For  the  task  of  developing  and  demonstrating  a set  of  systematic  procedures 
for  conducting  a team  job/task  and  training  analysis,  representative  samples 
of  TACFIRE  operations  were  selected  to  be  analyzed.  The  following  criterion 
categories  were  established  as  the  basis  for  the  selection  of  a TACFIRE  func- 
tional area: 

(1)  As  directed  in  the  statement  of  work,  the  job/task  and  training 
analysis  must  be  conducted  for  two  classes  of  team  training  (a)  the  man- 
computer-man  paradigm,  and  (b)  the  man- (noncomputer) -man  setting.  In  selecting 
an  aspect  of  TACFIRE  operations  for  analysis,  these  classifications  of  inter- 
action had  to  be  represented. 
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(2)  The  second  category  of  selection  criteria  had  as  a basis  that  the 
functions  to  be  analyzed  must  be  representative  of  critical  TACFIRE  operations. 
Within  this  category  the  following  criteria  were  posited:  (a)  the  function  Is 
directly  related  to  mission  success;  (b)  the  function  Is  performed  frequently; 
and  (c)  the  function  represents  a specific  block  of  activities,  l.e.,  has  a 
specific  beginning,  end,  and  logical  continuity  throughout. 

The  second  category  of  criteria  was  also  employed  by  ART  In  the  selection 
of  primary  functions  for  automated  Individual  (AI)  training.  In  that  analysis 
of  TACFIRE  documentation,  operation  of  the  system,  and  discussions  with  TACFIRE 
personnel,  ARI  concluded  that  many  of  the  functions  performed  at  the  Division 
Artillery  Fire  Direction  Center  (DlvArty  FDC)  and  the  Battalion  (Bn)  FDC  were 
similar.  Subsequently,  the  Bn  FDC  sphere  of  operations  was  selected  as  the 
organizational  context  for  developing  AI  training.  The  same  sphere  of  opera- 
tions has  been  Identified  as  appropriate  for  the  team  job/task  and  training 
analysis.  The  Bn  FDC  sphere  of  operations  fulfills  the  second  class  of  selec- 
tion criteria,  and  there  are  representations  of  both  man- computer-man  and  man- 
man  Interactions. 

The  TACFIRE  Bn  FDC,  Is  operated  essentially  by  a three  man  team:  the 
Fire  Direction  Officer  (FDO),  the  Fire  Direction  Sergeant  (FDS)  and  the  Com- 
munication Control  Unit  Operator  (CCUO).  The  major  figures  are  the  FDO  and 
FDS.  In  the  actual  selection  of  a function  area  for  the  team  job/task  and 
training  analysis,  a major  consideration  was  that  the  points  of  greatest 
Interaction  between  the  FDO  and  the  FDS  were  represented.  In  fact,  an  almost 
complete  overlap  exists  between  the  tasks  of  the  FDO  and  the  FDS  In  the  Bn 
FDC.  The  responsibility  for  operations  and  decision  making  rests  with  the 
FDO,  but  TACFIRE  operational  knowledge  and  skills  apply  to  both.  These  points 
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of  InCeracCion  have  been  Identified  both  within  the  TACFIRE  documentation  and 
previously  performed  job/task  analysis. 

In  reviewing  the  TACFIRE  documentation  and  the  functional  areas  of 
responsibility  of  the  Bn  FDC,  three  primary  points  of  Interaction  between  the 
FDS  and  the  FDO  emerged.  These  three  primary  points  fell  within  the  Tactical 
and  Technical  Fire  Control  Functional  area.  The  first  point  was  conduct  of  a 
fire  mission  (FM) — processing  fire  missions,  producing  firing  data,  and 
recording  and  reporting  fire  missions.  The  second  was  maintaining  and  updating 
the  data  bases  that  permit  tactical  and  technical  fire  direction  to  be  accom:- 
pllshed.  The  third  was  system  operating  messages  (SYS)  used  to  Initialize  and 
update  the  Fire  Control  Computer  files  for  operation  within  the  FDC  and  within 
other  subscribers. 

For  the  purpose  of  the  team  Job/task  and  training  analysis  the  first  of 
these  general  areas,  conduct  of  a fire  mission,  was  selected  for  analysis. 

The  content  and  procedures  In  conducting  a fire  mission  are  a conflate  entity 
In  themselves,  as  well  as  a culmination  of  the  application  of  Individual 
learning  that  has  occurred  In  TACFIRE  training.  In  addition,  the  conduct  of 
fire  missions  represents  a broad  range  In  complexity  for  team  training  tasks. 
Specifically,  the  analysis  focused  on  three  job  areas:  (1)  process  FM  In 
Automatic  Mode,  (2)  process  FM  In  Manual  Mode,  and  (3)  process  FM  received  by 
Voice  Communication. 


Job /Task  Analysis  Procedures 

The  major  questions  asked  In  the  team  job/task  and  training  analysis 
were:  (1)  what  does  a Bn  FDC  team  look  like  when  operating  In  an  established 


situation?  and  (2)  what  changes  In  team  Interactive  behaviors  may  occur  In 
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'' 

data  on  team  activities  and  performance  was  obtained  as  possible.  The  data 

t 

were  based  on  an  analysis  of  TACFIRE  documentation  prepared  by  the  U.S.  Army 
Field  Artillery  School  (USAFAS),  Ft.  Sill,  Oklahoma,  dir  t observation  of 
teams  during  a Command  Post  Exercise  (CPX)  at  USAFAS,  detailed  Interviews  with 
TACFIRE  personnel  at  USAFAS,  and  a survey  of  TACFIRE  Instructors. 

A detailed  team  job/task  and  training  analysis  was  made  of  the  Bn  FDC 
team  functions.  This  analysis  Included  a description  of  each  act  carried  out 
by  team  members  and  the  sequencing  of  the  acts.  Every  act  of  team  members  was 
broken  down  Into  three  elements:  Input , the  signal  or  stimuli  that  elicits 

the  behavior;  process,  the  response;  and  output,  the  signals  or  stimuli  i 

i 

resulting  from  the  process.  Each  act  was  then  linked  to  subsequent  acts  as 
either  a man-man  Interaction  or  a man-machine-man  Interaction.  In  this  way  It 
was  possible  to  set  up  a team  task  flow  for  the  established  situation.  Figure 
1 Is  a segment  extracted  from  a team  task  flow  chart. 

The  man-machine-man  Interaction  Is  representative  of  two  types  of  machines^ 
the  radio  and  the  computer,  and  of  two  types  of  machine  mediation.  The  first 

type  of  machine  mediation  requires  only  that  the  machine  be  a vehicle  for 

« 

transmitting  data  from  one  point  to  another.  The  radio  always  performs  this 
type  of  function;  the  computer  frequently  does.  The  second  type  of  machine 
mediation  requires  that  the  machine  perform  a function  which  before  Its  Intro- 
duction was  performed  by  man  or  a different,  and  probably  a less  sophisticated, 
machine.  The  function  may  be,  for  example,  a calculation,  record  keeping,  a 
check  of  procedures,  or  even  the  making  of  a decision.  Only  the  computer, 
with  Its  associated  peripherals,  can  perform  these  functions.  Thus,  In  the 
job/task  flow  charts  the  types  of  system  programs  (e.g.,  TTFC  and  AFU)  used 
for  data  analysis  and  manipulation  by  the  computer  are  Identified  as  well  as 
If  the  machine  mediation  Is  solely  for  the  data  transmittal. 
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Development  of  Team  Training  Objectives 


The  team  training  objectives  were  organized  by  task  and  subtask.  Criterion  . 

objectives  reflect  the  condition  and  behaviors  underlying  the  team  achievement  | 

of  a task.  Enabling  objectives  reflect  the  necessary  subtask  behaviors  of  | 

team  members  which,  collectively,  result  in  the  accon^llshment  of  the  task."" 

In  deriving  the  enabling  objectives,  each  subtask  was  examined  in  terms  j 

of  the  team  task  dimensions.  If  the  presence  of  a team  task  dimension  within  i 

a given  subtask  element  was  established,  then  an  enabling  objective  was 

developed  to  represent  that  dimension.  Thus,  each  subtask  element  was  reviewed  j 

within  the  learning  category /task  dimension  framework  constructed  during  Task 
1.  Table  4 presents  a sample  of  team  training  objectives. 

Scenario  Development 

The  major  objective  in  creating  the  COLT^  scenarios  was  to  develop  a team 
training  vehicle  rather  than  simply  a multiperson  drill  and  practice  sequence. 

As  a training  vehicle,  the  scenario  had  to  be  capable  of  incorporating  Instruc'- 
tlonal  strategies  reflecting  the  tasks  and  tactical  situations,  addressing 
individual  learner  requirements,  and  providing  for  the  computer  management  of 
all  facets  of  the  instruction  including  student  responses.  Thus,  the  scenarios 
had  to  be  structured  to  ensure  flexibility  at  the  decision  points  for  manipulat- 
ing training  resources  in  order  to  maximize  performance  and  minimize  training 
time.  With  this  objective  stated,  two  basic  assumptions  were  made: 

1.  Team  training  scenarios  are  task  and  environment  specific  in  nature. 

For  weapon  system  training,  the  scenario  must  represent  team  member  roles, 
information  flow,  decision  points,  problem  solving  requirements,  coordination 
activities,  operational  doctrine,  and  tactical  evolutions. 
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2.  The  critical  factors  In  a scenario-driven  team  training  process 
Include  perception  and  expectation  about  jobs,  coordinated  and  compensating 
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task/team  member  Interaction,  and  the  priorities  of  mission  events. 

The  emphases  underlying  both  assumptions  are  twofold.  First,  there  must 
be  adequate  incorporation  of  team  member  Interactions  In  the  Instructional 
strategies  underlying  the  scenarios.  Second,  the  team  member  interactions 
must  be  placed  in  a simulated  tactical  environment.  It  Is  believed  that  rich 
combat  representations  built  Into  the  scenarios  are  critical  to  the  Involve- 
ment of  the  trainee  at  more  than  a drill  and  practice  level.  The  following 
subsections  on  scenario  sequencing  and  scenario  structure  will  address  the 
Issues  In  more  detail. 

Scenario  Sequencing 

In  order  to  match  the  entry  level  and  projected  accumulative  learning  of 
the  subjects  with  the  variety  of  team  Interactions  present  In  a continuum  of 
tactical  cooibat  situations.  It  was  necessary  to  develop  the  scope  and  sequence 
of  scenario  presentations.  In  essence,  this  translated  Into  four  levels  of 
training  for  the  demonstration/evaluation.  These  levels  were  (1)  Individual 
training,  (2)  beginning  team  training,  (3)  Integrated  team  training,  and  (4) 
emergent  team  training.  The  scope  and  sequence  reflected  both  the  theoretical 
underpinning  as  well  as  the  Implementation  of  the  team  ISD  model.  That  Is,  It 
was  recognized  In  the  literature  that  a certain  level  of  individual  competence 
had  to  be  attained  before  the  students  could  effectively  be  trained  as  team 
members.  Secondly,  the  team  ISD  model  Is  in  part  based  on  the  assertion  that 
both  established  and  emergent  situations  which  reflect  the  actuality  of  the 
team  operational  situation  must  be  maintained  In  the  training  scenario.  The 
scope  of  each  scenario  within  the  training  progression  Incorporates  Increasing 
complexity  In  regard  to  team  member  roles.  Information  flows,  decision  and 
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problem  solving  requirements,  coordination  activities  and  tactical  evolutions. 

The  following  paragraphs  discuss  each  level  of  the  scenario  presentation. 

Individual  Training.  As  stated  In  the  above  paragraph,  the  project  team 
assumed  that  a minimum  level  of  Individual  competence  must  be  achieved  before 
team  training  can  be  effective  and  efficient.  The  first  Instructional  sequence 
was  designed  to  this  objective.  The  lesson  Included  lecture/discussion  sessions 
and  an  Individually-oriented  CAI  scenario.  The  lecture/dlscusslon  aspect  of 
the  Instruction  centered  on  teaching  the  basic  operational  doctrine,  rules, 
and  guidelines  to  be  followed  by  the  students  throughout  the  team  Instructional 
sequences.  Student  handouts  Included  basic  definitions  and  explanations  of 
the  operations  In  which  they  would  be  involved,  maps  and  statements  of  the 
rules  with  which  they  would  have  to  coiiq>ly  to  correctly  respond  to  various 
learning  events.  This  pre-CAl  Instructional  event  occupied  approximately  20 
minutes  of  the  demonstration/ evaluation  session.  Upon  completion  of  that 
session,  the  students  were  Introd'^^d  to  the  first  CAI  lesson.  This  lesson 
covered  the  rules,  regulations,  and  procedures  for  conducting  a TACFIRE  fire 
mission.  CAI  Instructional  strategies  Included  drill  and  practice  to  criterion 
levels,  tutorials.  Individual  feedback,  and  a debriefing  session  for  those 
subjects  selected  to  function  as  a team. 

Beginning  Team  Training.  The  second  sequence  of  scenarios  comprised  the 
beginning  team  lesson.  This  lesson  Introduced  the  subjects,  for  the  first 
time,  to  coordinated  sequence  drills.  In  addition,  problem  complexity  routines 
Increased  by  number  of  missions,  target  spread,  information  flows  (Including 
erroneous  Information)  and  team  problem  solving  activities.  The  COLT^  strategies 
for  the  beginning  team  lesson  also  Included  Individual  feedback  as  well  as 
team  debriefing.  Again,  the  beginning  team  training  essentially  was  doctrine 
training  on  TACFIRE  operations,  focusing  on  the  established  team  roles. 
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Integrated  Team  Training.  The  third  level  of  scenarios  represented 


Integrated  team  training.  The  Integrated  team  training  scenarios  were  originally 
designed  to  Incorporate  Instructional  strategies  which  related  to  coordination 
and  compensatory  Interactions.  That  Is,  the  team  members  were  to  be  presented 
with  multiple  tasks  which  were  to  be  Integrated  through  specific  decision 
processing  which  would  lead  to  the  allocation  of  team  resources.  This  Instruc- 
tional sequence  was  to  represent  the  multiple  mission  and  task  operations 
which  In  actuality  characterize  artillery  operations.  Thus,  the  team  would 
have  to  demonstrate  both  Individual  and  team  coordinated  (compensatory) 
behaviors  throughout  the  lesson.  The  decisions  base  would  be  dynamic,  pri- 
marily based  on  Individual  performances  and  mission-task  priorities.  The 
operational  conditions  for  the  Integrated  team  training  scenario  (e.g.,  equip- 
ment, personnel,  logistics,  etc.)  were  presented  In  a favorable  tactical 
evolution. 

However,  the  difficulty  of  programming  PLAMIT  to  handle  the  complex 
branching  and  communications  required  precluded  the  full  Implementation  of 
this  scenario.  In  actuality,  the  scenario  was  more  Individually  oriented, 
characterized  by  multiple  task  presentations. 

Emergent  Team  Training.  The  final  sequence  of  scenarios  was  for  emergent 
team  training.  These  scenarios  were  designed  to  Incorporate  all  Instructional 
strategies  previously  employed — specifically  emphasizing  those  of  major  com- 
plexity within  the  Integrated  team  training  scenarios.  Further,  the  Instruc- 
tional strategies  would  Incorporate  operational  fluctuations  (positive  and 
negative)  and  combat  catastrophes.  Again,  however,  the  development  of  the 
scenarios  was  limited  by  the  time  frame  for  dealing  with  subjects  and  the 
capability  of  PLANIT  to  handle  the  complex  switching,  branching,  review  and 
communications  required  for  Intrateam  manipulation  of  the  tasks. 
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The  actual  Instructional  sequence  prepared  for  the  subjects  Included  the 
presentation  of  a series  of  four  tactical  situations  In  which  decisions  were 
required  regarding  the  assignment  of  member  roles  and  the  structuring  of  the 
team.  After  the  decision  points  were  passed,  a series  of  questions  related  to 
team  member  attitudes  about  the  operation  were  asked  of  both  team  members. 

Then  the  team  members  received  an  evaluation  and  assessment  of  the  decision, 
with  hypothetical  performance  outcomes. 

Scenario  Structure 

The  scenario  structure  for  each  training  level  was  similar.  Basically, 
each  sequence  started  with  a description  of  the  tacMcal  situation.  This 
Included  all  relevant  Information  necessary  for  the  ^ ' feam  to  effectively 
conduct  a fire  mission.  Second,  the  tasks  requiring  student  execution  were 
presented.  Third,  there  was  a phaseout  which  presented  the  subjects  with  a 
s3aiopsls  of  the  effects  of  the  fire  missions  that  they  had  conducted.  Finally, 
for  each  of  the  subject  teams  there  was  a debriefing  session.  This  session 
Included  a discussion  of  the  Individual  performances  throughout  the  fire 
mission  and  an  assessment  of  the  overall  team  performance.  In  turn,  subjects 
were  allowed  to  discuss  their  own  role  interactions  and  to  discuss  any  team 
problem  solving  strategies  they  may  Implement  In  future  lessons. 

PLAMIT  Implementation* 

A primary  objective  of  this  investigation  was  to  assess  the  applicability 
and  potential  of  the  PLANIT  system  for  COLT^.  Under  the  aegis  of  ARI  PLANIT 
has  been  modified  by  Dr.  Charles  H.  Frye  of  the  Northwest  Regional  Educational 
Laboratory  to  support  team  training.  The  team  extension  of  PLANIT  was  based 

*For  the  demonstration,  PLANIT  was  Installed  on  ARI's  CDC  3300.  The  installation 
used  84K  bytes  of  core  memory.  The  remaining  program  was  divided  Into  18  par- 
titions; thus,  very  heavy  swapping  of  overlays  resulted  when  using  DIAL.  CALC, 
and  the  coimDon  matrix. 
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on  a logical  derivation  of  possible  language  requirements  for  team  training 
without  the  benefit  of  an  experience  of  actual  liiq>lementatlon  attempts.  The 
present  study  offered  the  first  opportunity  for  determining  the  adequacy  of 
this  Initial  PLAMIT  team  training  version. 

The  team  training  directives  Implemented  In  PLANIT  and  used  In  the  lesson 
development  of  this  study  were:  (1)  a common  lesson  matrix  that  could  be 
defined,  retrieved  or  updated  (the  FETCH  and  PUT  directives,  already  a part  of 
PLANIT,  are  used  to  manipulate  the  common  matrix) , and  (2)  use  of  the  DIAL 
directive  while  In  the  CALC  mode  or  as  a CALC  command  In  the  lesson  scenario. 
Four  team  training  CAT  considerations  are  tied  to  these  directives.  They  are: 
(1)  storage  and  retrieval  of  Information  related  to  scenario  events,  communi- 
cations, learning  events  sequences,  and  student  performance  via  the  common 
data  base,  (2)  Initialization  of  lessons,  (3)  synchronization  of  team  members 
to  scenario  events,  and  (4)  communications  among  team  members.  The  remainder 
of  this  subsection  discusses  each  of  these  major  considerations  and  how  they 
were  liiq>lemented  In  the  lessons  via  the  PLANIT  directives. 

Common  Data  Base.  The  common  data  base  In  PLANIT  was  adequate  for 
Implementation  of  the  Instructional  strategies,  for  the  tracking  of  events, 
event  sequencing,  and  synchronization  of  subjects. 

The  use  of  the  common  data  base  for  these  purposes  Involves  only  a matter 
of  appropriate  design  of  the  matrix  In  PLANIT.  However,  If  the  team  training 
lessons  of  the  future  are  to  be  Implemented  by  Army  Instructional  personnel 
for  example,  then  It  may  be  desirable  to  provide  commands  with  parameters  to 
set  the  values  of  a common  data  base  Indicating  sequences  of  events,  automatic 
designation  of  terminal  values,  and  synchronization  requirements. 

Initialization.  The  problem  of  Initializing  a common  lesson  base  for 
multiple  students  has  been  addressed  In  the  team  version  of  PLANIT.  Frye 
(1976)  describes  the  procedures  required. 


FRAPIE  l-OD  -CD} 


G2.  CRITERIA 

C:SET  flATRIXCXiaOI  C:SET  X-C1}=TERI1INAL  C:PUT  X 
F:@TYPE  'HI'TO  CONNECT  WITH  THE  OTHER  PLAYER. 


FRAME  a.ao  {(2> 

G3.  ANSUERS 
A HI 


FRAME  3.00  {»> 

62.  CRITERIA 
C:FETCH  X 

IF  X{1>  Efl  TERMINAL 

F:  not  there  YET.  WAIT  A MINUTE  AND  TRY  AGAIN.  B:2 
ELSE  C.-SET  HIMXCII  C : XCIITERMINAL  C:X{2>  = TIME  C:PUT  X 
C:PRINT  'OK-.  YOU  ARE  LINKED  WITH  TERMINAL  'iHIM  ROUNDCOJ 
IF  TERMINAL  IS  HIM  C:SET  MINE=3  C:SET  HIS=^ 

ELSE  C:SET  MINE=H  C:SET  HIS=3 


In  the  above  example,  the  two  players  will  be  connected  to 
the  team  scenario  by  both  GETtlng  the  same  lesson  name. 
Beginning  with  the  third  statement  in  frame  three,  the  logic 
Is  set  up  such  that  the  most  recently  answering  terminal 
will  be  Identified  by  number  In  the  first  common  entry,  and 
the  time  of  the  answer  In  the  second  entry.  The  Item  HIM 
will  be  the  terminal  number  of  the  other  player  and  can  be 
used  In  the  DIAL  command,  e.g.: 

DIAL  HIM  YOU  AND  I ARE  NOlil  TEAMED. 

The  third  and  fourth  entries  of  the  common  area  are  set  up 
for  communicating  code  values,  and  the  Items,  MINE  and  HIS 
are  defined  properly  so  that  separate  entries  will  be 
assigned.  MINE  and  HIS  would  be  used  frequently  to  subscript 
the  matrix  X after  a FETCH  or  between  a FETCH/PUT  update 
sequence. 

The  next  example  will  perform  the  Initial  acquisition  for 
three  team  members.  This  logic  can  be  extended  to  as  many 
members  as  desired.  Having  acquired  all  members  of  the 
team,  a branch  Is  made  to  another  lesson  where  each  team 
member  will  be  In  a different  lesson.  The  common  lesson 
matrix  will  be  valid  for  all  three  lessons.  Each  lesson 
will  then  proceed  according  to  the  role  of  that  particular 
team  member: 
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FRAflE  1.00  {».> 


G2.  CRITERIA 
C:SET  HATRIX-CXiaO} 

IF  LINK-C10>  Nd  0 C:PUT  X C : LINK-C10>=0 
ELSE  C:LINK{10>=1  CtFETCH  X C:LINK{10>=0 
IF  X{1>  Nl3  0 F0R{I*li3> 

F:S0RRY-.  all  POSITIONS  ARE  TAKEN.  ANOTHER  TINE.  C:FINISHED 
ELSE  F:@ARE  YOU  RED-.  YELLOW  OR  BLUE? 


FRAME  S.OQ  Cfl} 

G3.  ANSWERS 
> KEYWORD  ON 
A RED 
B YELLOW 
C BLUE 

GM.  ACTIONS 
A C:SET  C0L0R=1 
B C:SET  C0L0R=2 
C C:SET  C0L0R=3 

- R:ANSWER  ONE  OF  THE  THREE  OR  TYPE  'FINISHED.' 


FRAME  3.00  {D> 

GB.  CRITERIA 

IF  XCCOLORI  N(3  0 F;SORRY-.  WE  HAVE  ONE  OF  THOSE  ALREADY. 
F: CHOOSE  ANOTHER.  B:2 

ELSE  C:FETCH  X C : X{COLOR}=TERMINAL  C : XCIII^TERMINAL 
C:X{20}=TIME  C:PUT  X B:S 


FRAME  M.OO  -Cfll 
TEXT 

DON’T  HAVE  ALL  THE  PLAYERS  YET.  TYPE  'GO*  AND  I'LL 
CHECK  AGAIN. 

G3.  ANSWERS 
A GO 


FRAME  S.OO  CD! 

G2.  CRITERIA 
CsFETCH  X 

IF  PROD  X{I>  F0R{I=l-.3>  Efl  0 B:M 

ELSE  F:OK-.  LET'S  GO.  BrREDi  YELLOW-.  BLUE:  COLOR 
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In  this  exaiiq>le,  the  first  entry  of  common  has  the  terminal 
number  of  RED,  the  second  has  YELLOW,  and  the  third  has 
BLUE.  The  19th  entry  shows  the  number  of  the  most  recent 
teirminal  to  answer  and  the  20th  entry  shows  the  time  of  the 
answer.  Finally,  a branch  is  made  to  one  of  the  three 
lessons,  each  of  which  presumably  contains  logic  that  per- 
tains to  a particular  player. 

Synchronizat ion . During  team  training  interactions,  it  is  frequently 
necessary  to  determine  where  each  individual  student  is  in  the  sequence,  and, 
depending  on  the  instructional  sequencing  design,  it  may  be  desirable  to  stop 
a student  at  some  point  while  another  team  member  catches  up  or  performs 
another  action  which  will  Influence  or  be  dependent  upon  another  team  member. 

Thus,  two  important  aspects  of  synchronization  are  derived.  First,  it  is 
necessary  to  test  for  the  occurrence  of  events  or  team  member  status  in  the 
instructional  sequence.  Second,  it  is  necessary  at  times  to  hold  a team 
member  in  place.  In  both  cases,  student  progress  (events)  must  be  tested  in 
order  to  properly  sequence  member  interactions.  Several  ways  of  testing  for 
events  can  be  Illustrated  with  examples  from  the  lesson  Implemented  for  the 
demonstration  and  from  examples  extracted  from  Frye  (1976) . 

Further,  the  Initialization  examples  previously  presented  also  showed 
Instances  of  synchronous  operations  since  no  player  is  allowed  to  proceed 
until  all  have  signed  into  the  system.  Another  example  of  synchronization, 
provided  by  Frye,  follows.  In  this  case  no  one  is  allowed  to  proceed  beyond 
frame  10  until  all  are  together. 

FRAME  a.DD  tD} 

G2.  CRITERIA 

C:FETCH  X C : X-CC0L0R  + 1D>=1D  C:PUT  X 

FrTHERE  MAY  BE  A SHORT  DELAY  UNTIL  EVERYONE  CATCHES  UP. 
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FRAHE  1.00  •[»> 


t C: FETCH  X 

IFXCI>  E<3  ID  F0RCI  = 11,13}  B:ll 


FRAHE  10.00  -CO 


GE.  TEXT 
TYPE  'GO' 

Ga.  ANSlilERS 
A GO 

G^.  ACTIONS 

FtOKi  WILL  CHECK  Brl 


In  the  'brassboard' , students  interacted  with  the  system  and  each  other 
to  simulate  the  sequence  of  events  comprising  a fire  mission.  Frequently,  the 
FDO  was  required  to  take  an  action;  the  FDS  evaluated  that  action;  the  FDS 
then  was  required  to  take  an  action  himself.  This  required  holding  the  FDS  in 
place  until  the  FDO  had  taken  an  action  and  the  FDS  had  received  a communication 
from  the  FDO  stating  what  the  action  was. 

For  example,  a series  of  frames  of  the  sort  below  was  presented.  Each 
required  the  above  described  sequence  of  rtsponses  by  the  FDO  and  FDS. 


FIRE  MISSION 

RED  THUNDER  13  - THIS  IS  UILD  HORSE 
t - FIRE  MISSION.  INFANTRY  PLATOON  IN 
THE  OPEN-.  UILL  ADJUST  FIRE. 

TGT  NO.  IS  INFANTRYl. 

TAKE  ACTION 

1.  PAGE  ^.  CORRECT 

a.  FIRE  S.  PROBLEM 

3.  CLEAR 


Each  frame  v seen  by  both  team  members.  The  FDO  answered  first,  and  his 
action  was  communicated  to  the  FDS.  However,  his  message  could  be  transmitted 
only  after  the  FDS  had  received  the  complete  display  as  shown.  Furthermore, 
the  FDS  could  be  allowed  to  respond  only  after  receiving  the  FDO's  message. 

The  lesson  sequence  to  control  this  synchronization  was  as  follows ; 
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FRAHE  5.00  -CD}  LABEL=REAI>Y 
GROUP  2 

C:FETCH  X C : XEln  1 n 1}=RESP0NSE  C : XE3 3 1>  = X{3-,  3-.  1>  + 1 C:PUT  X 
IF  X{3-.3-.l>  LS  S{3-.3-,2}  B:SYNC  •CXE3-.3-.l> 

IF  XI3-.3-.lJ  E(3  X-C3-.3-,2}  B:& 

ELSE  F:|$ 


FRAHE  t,.00  -CflJ 
GROUP  3 
a blAIT  5 
A AZS 
GROUP  M 
-A  F -.STANDBY 


FRAME  7.00  -CDJ 
GROUP  2 
C 2 FETCH  X 

IF  X-Cl-.M-.2>  E(2  0 F:YOUR  TEAMMATE  IS  GONE.  B:M.S 
IF  X-C3-.3-.1}  GR  X-C3-.3-.2>  F:|$  B:t, 


FRAME  fl.OO 

"CANNED  MESSAGE  FRAME"  - to  be  described  in  following  subsection. 

FRAME  a. 10 
GROUP  2 

B:SYNC-CX-C3-.3-.1JJ 


i 

!■ 


FRAME  T.OD  -C(3> 

GROUP  2 

FIRE  MISSION 

RED  THUNDER  13  - THIS  IS  UILD  HORSEb  - 
FIRE  MISSION.  INFANTRY  PLATOON  IN  THE 
OPEN-.  UILL  ADJUST  FIRE. 

TGT.  NO.  IS  INFANTRY  1. 

TAKE  ACTION 

1.  PAGE  M.  CORRECT 

2.  FIRE  5.  PROBLEM 

3.  CLEAR 
GROUP  3 

I-H 

2 ^ WITHIN  2 
GROUP  M 

1 F:  your  answer  IS  RIGHT  — EVERYTIME 

F:  YOU  RECEIVE  THE  FM  NOTIFICATION  YOU  ’PAGE' 
F:  TO  CHECK  FOR  A WARNING-  B:READY 

2 F:  THE  CORRECT  RESPONSE  IS  'PAGE'-  YOU 
F:  MUST  'PAGE'  THROUGH  THE  MESSAGE  TO 
F:  check  for  A WARNING.  B:READY 

R;  CHOOSE  A NUMBER  FROM  THE  LIST 
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It  should  be  noted  that  in  this  sequence  (part  of  the  FDO's  lesson  at  the 


1 

beginning  team  level)  a branch  to  the  frame  labeled  "READY"  is  made  after  a 
legitimate  response.  READY  is  frame  number  5.00.  Its  major  purpose  is  to 
increment  a counter  stored  in  the  common  matrix  for  tracking  the  FDO's  position 
in  the  lesson  and  comparing  it  to  the  FDS  lesson  position.  Cell  3,3,1  in  matrix 
X served  this  purpose  for  the  FDO.  Cell  3,3,2  was  used  for  tracking  the  FDS, 
and  a similar  frame  sequence  existed  in  the  FDS  lesson.  In  frame  5.00,  if  the 
FDO  and  FDS  had  been  at  the  same  point  in  the  lesson,  a branch  to  frame  8 
would  have  been  made  to  transmit  a canned  message.  Frame  8.1  was  then  executed 

; 

to  a branch  to  the  frame  number  in  an  array  "SYNC"  designated  by  the  value  of 
3,3,1.  If  the  value  of  3,3,1  was  less  than  3,3,2,  the  FDS  had  already  been 
sent  the  message  and  a similar  branch  could  be  made  through  the  array  SYNC  to 
allow  presentation  of  the  next  frame  to  the  FDO.  If  neither  of  these  two 
conditions  were  true  (3,3,1  was  greater  than  3,3,2)  the  FDS  was  behind  the  FDO 
and  not  ready  to  receive  the  message.  In  this  case,  frame  6.0  would  be 
executed  to  Inform  the  FDO  to  standby.  Frames  6.00  and  7.00  form  a standby 
loop  to  hold  the  FDO  until  the  FDS  could  get  into  proper  lesson  position. 

Communications . Two  forms  of  communicating  between  team  members  are 

available  in  the  team  version  of  PLANIT.  The  DIAL  directive  is  used  for  both  ] 

1 

forms.  First,  team  members  may  use  DIAL  to  initiate,  compose,  and  exchange  1 

messages  at  the  terminal.  Second,  messages  can  be  written  into  the  lesson.  | 

i 

Having  assigned  terminal  members  to  variable  CALC  names,  targets  of  the 
'canned'  messages  can  be  designated  in  the  scenario.  The  recipient  of  the 
message  will  see  the  sender's  name  as  part  of  the  message.  However,  the 
sender  would  not  know  that  he  is  transmitting  a message  unless  he  is  told. 

For  the  COLT^  lessons,  four  aspects  of  communications  were  Important: 

(1)  control,  (2)  content,  (3)  timing,  and  (4)  recording.  Control  relates  to 


J 


t 

I 


, 

which  team  members  Initiate  messages  and  which  receive  messages.  Content  is 
the  subject  of  the  message.  Timing  relates  to  when  messages  are  si'nt  . 

Keeordliig  ol  messages  ri*laLi>s  to  the  stoi  lng  of  tiu'  above  three  lor  evalnativi' 
purposes.  If  the  terminal  oriented  DIAL  directive  had  been  utilized,  none  of 
these  four  aspects  would  have  to  be  controlled.  For  this  initial  investigation 
into  C0LT2,  it  was  desirable  to  have  a capability  for  directing  and  storing 
communications.  Therefore,  the  DIAL  messages  were  written  into  the  lessons. 

A series  of  five  messages  representing  the  array  of  possible  FDO  responses 
at  a decision  point  were  coded  into  the  lesson.  The  message  to  be  transmitted 
to  depended  on  the  decision  made  by  the  FDO.  An  example  of  the  message  frame  ' 

follows : 

FRAME  a. DO  {P> 

GROUP  5 

B : Ml ME MB  1 MM MS'i  X-Cl  •.  1 •.  1> 

MlrDIAL  FDST  I THINK  'PAGE'  IS  THE  RIGHT  ANSWER.  B:TAIL 
naiOIAL  FDST  I THINK  'FIRE'  IS  THE  RIGHT  ANSWER.  B:TAIL 
M3:DIAL  FDST  I THINK  'CLEAR'  IS  THE  RIGHT  ANSWER.  B:TAIL 
MMrDIAL  FDST  I THINK  'CORRECT'  IS  THE  RIGHT  ANSWER.  B:TAIL 
ns:  DIAL  FDST  I DO  NOT  KNOW  RIGHT  ACTION-.  YOU  CHOOSE. 

tail: 

Prior  to  reaching  this  frame  in  the  lesson,  the  value  of  cell  1,1,1  in 
the  common  matrix  was  set  to  a value  determining  which  message  (Ml,  M2,  M3, 

MA,  M5)  was  to  be  sent  to  the  FDS  terminal  (FDST)  by  the  FDO.  The  event  value, 
determining  the  message  in  this  case  was  the  action,  selected  by  number,  to  be 
taken  in  the  fire  mission.  X(l,l,l)  was  therefore  set  to  the  value  of  the 
PLAMIT  primitive  response.  The  conditional  branch  statement  in  line  1 Group 
2,  Frame  8,  above  therefore  selects  the  message  to  be  sent  to  the  FDS  appropri- 
ate to  the  FDO's  action.  This  capability  of  PLANIT  to  select  the  particular 
message  is  probably  adequate  for  most  purposes  where  the  message  sequences  are 
pre-prepared  as  part  of  the  lesson  data  bose. 
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BRASSBOARD  DEMONSTRATION/EVALUATION 


The  purpose  of  the  brassboard  demonstration/evaluation  was  twofold. 

First,  an  assessment  of  the  instructional  strategies  sampled  In  the  scenario 
was  accomplished.  The  output  of  this  aspect  of  the  study  Is  (1)  a report  of 
the  findings,  and  (2)  research  recommendations  for  instructional  strategy, 
scenario,  and  Job/task  analysis  Issues  which  remain  unaddressed.  The  second 
function  served  by  the  "pilot  study"  was  the  assessment  of  the  applicability 
of  the  PLANIT  language  for  team  training.  The  output  of  this  facet  of  the 
study  is  a set  of  recommendations  for  PLANIT  language  extensions  necessary  for 
a full  team  training  capability.  The  remainder  of  this  section  will  contain  a 
description  of  the  brassboard  demonstration/evaluation  implementation  pro- 
cedures and  the  findings  of  the  study.  The  following  section  provides  a more 
detailed  discussion  of  the  implications  of  the  findings. 

Sub j ects 

The  subjects  were  40  Army  enlisted  men  from  commands  In  the  Washington 
area.  The  ranks  of  the  subjects  ranged  from  E-3  to  E-7,  with  more  than  75 
percent  of  the  subjects  being  E-A's  or  E-5's.  A variety  of  military  occupa- 
tional specialties  (MOS)  were  represented.  However,  a majority  of  subject 
MOS's  were  related  to  administrative  and  clerical  jobs.  Table  5 presents  a 
summary  of  other  characteristics  of  the  subjects. 


Table  5.  Sunmiary  of  Subject  Characteristics 


r" 


Variable 

Mean 

S.D. 

Age 

25.3 

4.8 

Years  in  Service 

5.3 

4.2 

Educational  Level 

13.0  (years) 

1.4 

GT 

114.8 

11.4 

Design 

The  demonstration/evaluation  was  conducted  in  four  steps.  During  the 
initial  step,  subject  biographical  data  was  collected,  and  two  individual 
difference  scales  were  administered.  These  scales  were  the  Rotter  I-E  Scale 
(Rotter,  1966)  for  assessing  locus  of  control  and  the  A-Trait  section  of  the 
State-Trait  Anxiety  Inventory  (Spielberger , Gorsuch  and  Lushene,  1970).  After 
completing  these  scales,  students  were  assigned  to  work  through  the  subsequent 
instructional  materials  on  either  a team  or  an  Individual  basis.  This  assign- 
ment war  conducted  on  a random  basis.  Additionally,  team  members  were  assigned 
roles;  that  is,  they  were  selected  to  undergo  the  instruction  either  as  a fire 
direction  officer  or  as  a fire  direction  sergeant.  Again,  the  assignment  of 
roles  was  conducted  on  a random  basis. 

Step  2 involved  presenting  the  subjects  with  preliminary  background 
information  regarding  subsequent  tasks  that  they  would  be  performing.  Pri- 
marily,  this  lesson  taught  the  subjects  how  to  conduct  the  basic  fire  mission. 

The  instruction  was  lecture/discussion  with  students  having  handouts  and 
exercises  to  work  through.  Upon  completion  of  this  phase  of  Step  2,  the 
subjects  were  introduced  to  their  first  computer-assisted  instruction  lesson. 

The  first  lesson  was  individually  based,  with  all  subjects  going  through 
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identical  information  sequences  with  no  coordinated  (team)  activities  required. 

At  the  conclusion  of  this  lesson,  the  subjects  took  a 15  item  test  presented  by 
the  computer. 

After  subjects  had  been  familiarized  with  the  procedures  for  conducting  a 
fire  mission,  the  team  began  work  on  their  first  coordinated  Instructional 
task.  The  basic  team  task  requirements  were  identical  for  all  teams  and 
consisted  of  sequences  of  increasingly  complex  fire  missions.  The  subjects 
operating  in  an  individual  mode  were  presented  with  the  same  materials  that 
were  presented  to  the  teams.  However,  subjects  were  not  required  to  coordinate 
their  activities  with  another  team  member.  There  were  39  student  executions 
(decisions)  required  in  this  lesson.  At  each  execution  point,  subjects  were 
required  to  make  a procedural  response  within  a tactical  fire  mission  context. 
During  the  lesson  individual  feedback  was  presented  to  all  subjects.  At  the 
conclusion,  the  teams  were  debriefed  and  allowed  to  discuss  role  assignments 
and  team  interactions. 

Step  3 focused  on  the  integrated  team  lessons.  As  stated  in  the  prior 
section,  the  Integrated  team  materials  were  not  presented  to  the  subjects  in 
the  manner  in  which  originally  designed  because  of  the  software  limitations. 
Originally,  the  Integrated  team  lesson  was  to  confront  the  team  leader  and  the 
other  team  member  with  a continuum  of  tactical  role  assignment  decisions. 

After  each  decision,  to  be  made  either  individually  by  the  team  leader  or  in 
concert  with  his  fellow  team  member,  specific  tasks  had  to  be  performed  by  the 
team  members.  At  the  conclusion  of  each  set  of  tasks,  a new  tactical  situation 
would  arise  where  multiple  tasks  again  would  have  to  be  integrated  and  team 
resources  allocated.  In  actuality,  the  lessons  did  not  Include  the  decision 
making  properties.  There  were  a combination  of  tasks  to  be  performed,  but 
events  were  sequenced  by  the  lesson  rather  than  the  learner.  The  only  difference 


in  strategies  between  the  team  and  individual  subjects  was  the  fact  that  at 
certain  points  throughout  the  instruction,  the  teams  were  coordinated  and  did 
receive  team  feedback  on  perfeimance. 


The  last  phase  consisted  of  the  emergent  team  lessons.  The  materials 
were  presented  as  described  in  the  prior  section.  Primarily,  they  constituted 
a series  of  tactical  situations  in  which  specific  artillery  fire  mission 
problems  were  presented.  At  each  of  these  decision  points,  both  the  FDO  and 
FDS  were  allowed  to  respond  as  to  what  action  they  would  take  to  resolve  the 
problem.  In  the  team  environment,  however,  the  decision  made  by  the  FDO  was 
the  one  that  counted.  After  each  decision  was  made,  both  team  and  individual 
subjects  were  presented  with  a series  of  questions  relating  to  their  confidence 
in  the  decision,  role  assignment,  and  projected  team  performance. 

At  all  steps  drill,  problem  complexity  in  sequencing,  and  feedback  strate- 
gies were  similar.  The  teams,  however,  were  working  through  coordinated 
sequence  drills;  whereas,  individuals  were  not.  Another  major  difference  was 
that  team  debriefings  were  more  extensive,  with  team  members  being  apprised  of 
each  other's  scores  and  having  the  opportunity  to  discuss  future  role  assign- 
ments. 

Measures 

Basically,  three  categories  of  measures  were  collected:  (1)  entry 
behaviors,  (2)  performance  ratings,  and  (3)  attitudes.  Entry  behaviors 
included  the  variables  of  age,  years  in  service,  educational  level,  GT,  mili- 
tary occupational  speciality,  rank,  stress  anxiety,  and  locus  of  control. 

Locus  of  control  was  assessed  by  means  of  the  Rotter  I-E  scale.  Locus  of 
control  is  a theoretical  construct  that  refers  to  the  degree  to  which  individuals 
believe  that  reinforcement  is  either  directly  contingent  upon  their  own  behaviors 
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or  Independent  of  them  and  attributable  mostly  to  chance.  The  former  type  of 
belief  Is  ascribed  to  people  at  the  Internal  end  of  the  locus  of  control 
continuum  and  Indicated  by  low  scores  on  the  Rotter  I-E  scale.  Individuals 
with  high  scores  are  at  the  external  end  of  the  locus  of  control  continuum. 

There  were  two  reasons  for  selecting  locus  of  control  as  an  Individual 
difference  variable  In  the  present  research.  First,  the  available  evidence 
indicates  that  locus  of  control  Is  sufficiently  consistent  and  powerful  In  Its 
effects  upon  behavior  to  justify  Its  use  as  a basis  for  selection  of  team 
members.  Second,  although  research  findings  regard  the  Influences  of  locus  of 
control  on  classroom  behavior  and  achievement  as  equivocal,  where  significant 
differences  have  been  attained,  higher  achievement  generally  tends  to  be 
positively  correlated  to  an  Internal  orientation,  particularly  under  learner 
control  methods.  (Daniels  and  Stevens,  1976;  Nord,  Connelly  and  Dalgnault,  1974). 
Considering  that  the  instructional  task  Investigated  in  this  study  is  computer 
based  and  has  a potential  for  allowing  students  an  extensive  amount  of  Individual 
control,  it  was  reasoned  that  locus  of  control  could  serve  as  a meaningful 
predictor  of  task  achievement. 

The  second  Individual  difference  scale  employed  In  this  study  was  the 
trait  anxiety  scale  developed  by  Spielberger.  The  state-trait  anxiety  theory 
as  formulated  by  Spielberger  (1966)  emphasizes  the  practical  and  theoretical 
Importance  of  differentiating  between  anxiety  as  a relatively  stable,  generalized 
personality  trait  and  as  a situationally  dependent  state  or  condition  that 
varies  In  Intensity  over  time.  The  subsequent  development  of  the  state-trait 
inventory  (Spielberger,  et  al. , 1970)  was  Intended  to  establish  a means  for 
characterizing  Individuals  In  terms  of  both  dimensions.  These  types  of  findings 
have  definite  value  from  the  standpoint  of  allowing  one  to  forecast  with 
reasonable  accuracy  how  students  tend  to  react  to  stressful  stimuli  over  time 
In  a variety  of  situations. 
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On  the  basis  of  the  previous  research,  the  following  judgments  were  made 


1 


concerning  the  role  of  anxiety  variables  in  the  present  investigation. 

1.  The  available  literature  on  anxiety  provides  a strong  empirical  and 
theoretical  rationale  for  using  a trait  anxiety  variable  as  a basis  for  pre- 
dicting student  performance  under  differing  modes  of  Instruction  (e.g.,  team 
vs . individual) . 

2.  With  regard  to  the  use  of  trait  anxiety  as  a predictor  variable,  it 
was  assumed  that  some  students  would  find  the  coordinated  structural  activities 
significantly  more  stressful  than  would  others.  Anxiety  theories  suggest  that 
the  probable  consequences  of  such  reactions  would  be  greater  dlstractlbility 
during  acquisition  and  lower  performance  on  the  final  test.  It  was  therefore 
reasoned  that  anxiety  variables  would  provide  a useful  basis  for  selecting  and 
refining  instructional  strategies,  particularly  given  team  and  individual 
instructional  sequencing. 

Performance  Measures.  Within  each  Instructional  lesson,  performance 
scores  were  collected.  At  the  conclusion  of  the  individual  lesson,  there  was 
a 15  item  quiz.  During  the  beginning  team  lesson,  there  were  39  decision 
points  with  student  response  data  being  collected  at  each  point.  Student 
performance  on  the  integrated  lesson  was  evaluated  at  decision  points  within 
fire  missions  and  by  a second  criterion  qui  of  10  items.  Finally,  in  the 
emergent  team  lesson,  there  were  four  decision  points  about  which  student 
responses  were  collected.  Response  time  was  kept,  but  it  was  more  a measure 
of  machine  response  time  than  student  reaction. 

Attitude  Measures.  Attitude  measures  were  collected  only  during  the 
Integrated  team  lesson.  These  took  the  form  of  seven  confidence  and  role 
assignment  related  items  which  were  administered  subsequent  to  each  tactical 
decision  being  made. 
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Findings 
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Means  and  standard  deviations  for  subject  characteristics.  Individual 
difference  scales,  and  performance  scores  are  presented  In  Table  6 by  total 
group,  team  FDO,  team  FDS,  and  the  Individual  Instruction  subjects  (IND) . 
Although  the  subjects  were  randomly  assigned  to  groups  there  were  significant 
differences  between  groups  In  regard  to  some  variables.  The  FDO  group  had 
approximately  one-half  year  more  of  education  (X  = 13.31)  than  dia  the  FDS 
group  (X  = 12.75)  and  the  IND  group  (X  = 12.75).  The  t value  for  both  dif- 
ferences is  6.098,  p > .001.  The  GT  score  for  the  FDO  group  was  significantly 
greater  (t  = 6.936,  p > .001)  than  the  FDS  GT,  which  in  turn  was  significantly 
higher  (t  = 8.113,  p > .01)  than  the  GT  score  for  IND. 

There  were  also  significant  differences  between  groups  for  the  two 
Individual  difference  scales.  The  FDS  T-anxiety  rating  was  greater  than  both 
the  FDO  (t  = 15.856,  p > .01)  and  the  IND  (t  = 13.079,  p > .01)  groups.  There 
was  no  difference  on  the  T-anxlety  rating  between  FDO  and  IND  subjects.  The 
Rotter  results  were  similar  to  the  T-anxlety  scores;  that  Is,  the  FDS  rating 
was  significantly  higher  than  the  scores  for  FDO  (t  = 4.190,  p > .01)  and  the 
IND  (t  = 2.851,  p > .01)  groups.  Thus,  the  FDS  group  was  characterized  as 
demonstrating  a higher  level  of  Trait  anxiety  and  a greater  tendency  toward  an 
external  locus  of  control. 

On  Initial  performance,  a 15-item  quiz  concluding  the  Individual  CAI 
lesson  (see  Ind.  Score  In  Table  6),  the  FDO  group  scored  significantly  higher 
than  the  FDS  (t  - 14.286,  p > .001)  and  the  IND  (t  = 12.806,  p > .01)  groups. 
Both  FDS  and  IND  groups  made  significant  gains  In  their  scores  on  the  beginning 
1 iMat  nuMsuri's.  Ouriiig  th.U  lesson,  FDS  subjects  were  coordinating  their 
responses  with  the  FDO  subjects.  IND  subjects  received  the  same  instructional 
materials  but  were  operating  alone.  In  the  Integrated  lesson,  FDS  and  FDO 
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scores  dropped  while  the  IND  scores  were  maintained  at  the  same  level  as  the 
beginning  team  lesson  scores.  The  only  group  to  significantly  Increase  its 
score  from  the  individual  lesson  to  the  integrated  lesson  was  the  IND  (t  = 

2.083,  p > .05).  In  fact,  both  FDO  and  FDS  scores  dropped  from  the  individual 
lesson  to  the  Integrated  lesson. 

Figure  2 illustrates  the  performance  of  the  groups.  It  is  interesting 
to  note  that  the  coordinated  training  presented  to  the  team  subjects  in  the 
beginning  lessons  did  not  seem  to  Increase  their  individual  skills  substantially. 
As  each  set  of  lesson  materials  was  gauged  to  be  more  difficult,  it  cannot  be 
stated  absolutely  that  the  team  training  had  no  effect  on  individual  proficiency. 
The  comparison  of  FDO  and  FDS  performance  with  IND  is  dramatic,  however.  The 
continuous  individual  training  appears  to  lend  Itself  to  systematic  performance 
Increments.  On  the  other  hand,  coordinated  behavior  apparently  leads  to 
better  achievement  on  specific  established  tasks,  but  both  FDO  and  FDS  subjects 


Figure  2.  Lesson  Performance  By  Group 
b‘) 


f; 

1' 

y ■ 

i 

] 

I 

j 

1 


demonstrated  substantial  performance  decrements  on  subsequent  Individually- 
oriented  tasks.  The  findings,  limited  in  their  inferential  power  because  of 
the  small  number  of  subjects  and  the  anecdotal  nature  of  the  evaluation, 
indicate  that  there  are  differences  between  the  effectiveness  of  team  and 
individual  instruction  in  regard  to  what  types  of  behaviors  are  being  learned. 

In  addition  to  performance  scores,  lesson  completion  times  were  collected. 
Table  7 presents  the  means  of  these  times  by  group. 


Table  7.  Mean  Times  (minutes)  For  Lesson  Coiiq>letion 


All  Subjects 

FDO 

FDS 

IND 

Ind.  Lesson 

27.93 

26.28 

27.00 

Beg.  Lesson 

54.81 

54.81 

24.51 

Int.  Lesson 

21.45 

19.02 

19.56 

As  can  be  seen  in  Table  7,  the  only  substantial  difference  among  the  groups 
occurs  in  the  beginning  team  lesson.  During  this  lesson  the  FDO  and  FDS 
subjects  were  working  on  coordinated  events;  the  IND  subjects  were  working  in 
an  individual  mode.  The  magnitude  of  the  differences  between  the  team  and 
individual  modes  is  in  part  due  to  current  software  limitations  of  PLANIT. 

In  fact,  there  was  an  appreciable  difference  between  mean  completion  times 
depending  on  whether  one  team  or  two  teams  were  operating.  The  mean  comple- 
tion time  for  the  former  situation  was  44.46  (high  » 49.29,  low  ~ 41.64); 
for  the  latter  it  was  59.97  (high  - 63.66,  low  = 54.03).  In  short,  although 
an  Increase  in  mean  completion  time  was  expected  for  the  teams,  the  magnitude 
of  the  reported  difference  is  not  due  solely  to  the  nature  of  the  coordinated 
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Correlational  Analysis.  The  correlation  coefficients  and  significance 


levels  for  the  Independent  variables  and  performance  scores  are  presented  In 
Table  8.  Five  Independent  measures  and  three  performance  scores  are  represented 
In  the  matrix. 

Of  the  five  Independent  variables,  GT  correlated  more  highly  and  more 
consistently  with  task  performance  than  did  any  of  the  other  variables. 

Rotter  correlated  significantly  (r  ■»  .34,  p = .016)  with  the  Individual 
lesson  score  but  the  correlation  coefficient  diminished  over  the  other  two 
lessons.  The  same  was  true  of  educational  level.  This  variable  had  a 
relatively  high  correlation  with  the  Individual  lesson  score  (r  « .43,  p •• 

.003);  then  dropped  appreciably  In  magnitude  and  had  a direction  change.  As 
was  expected,  anxiety  negatively  correlated  with  all  task  performance  measures. 

In  addition  to  product  moment  analysis,  stepwise  regressions  were  run 
against  the  dependent  variables  of  Individual  lesson  score  and  beginning 
lesson  score  (see  Tables  9 and  10) . The  Independent  variables  regressed 
against  Individual  lesson  score  were  years  in  service,  educational  level,  GT, 
anxiety,  and  Rotter.  The  beginning  lesson  score  regression  also  Included  the 
Individual  lesson  score  as  an  Independent  variable. 

As  can  be  seen  In  Table  9,  the  multiple  correlation  coefficients  are 
reasonably  substantial  for  all  three  groups.  The  order  and  magnitude  of  the 
Independent  variables  change  across  groups,  however.  For  FDO  and  IND,  Rotter 
and  GT  account  for  the  preponderance  of  the  explained  variance.  For  FDS,  the 
two  variables  contribute  substantially  less  to  the  multiple  R. 

The  regression  against  the  beginning  team  score  also  resulted  in  substan- 
tially high  multiple  correlation  coefficients.  What  Is  Interesting  Is  the 
comparison  of  the  two  regressions.  As  anticipated,  the  order  and  magnitude 
of  the  Independent  variables  for  both  IND  regressions  are  similar.  Rotter 


Table  9.  Summary  of  Stepwise  Regression. 

Dependent  Variable : Individual 
Lesson  Score 


Variable 

Multiple  R 

r2 

R^  Change 

Simple  R 

B 

Beta 

Group : 

EDO 

Rotter 

.50 

.25 

25 

.50 

.02 

.06 

GT 

.56 

.31 

6 

.46 

.01 

.08 

Education 

.58 

.33 

2 

.03 

-.53 

-.33 

Years  in  Service 

.59 

.35 

1 

-.33 

-.26 

-.53 

Anxiety 

.65 

.43 

8 

-.39 

-.17 

-.50 

Group : 

FDS 

Education 

.68 

.46 

46 

.68 

1.26 

.66 

GT 

.70 

.49 

3 

.27 

.08 

.19 

Rotter 

.70 

.49 

0 

.07 

-.04 

-.06 

Group : 

IND 

Rotter 

.73 

.53 

53 

.73 

.82 

1.01 

GT 

.83 

.69 

16 

.36 

.13 

-.47 

Years  In  Service 

.88 

.77 

8 

.08 

-.20 

-.35 

Anxiety 

.91 

.82 

5 

-.34 

.14 

.29 

Education 

;9i 

.83 

0 

.45 

.16 

.07 

■y  ' 

en 

L S< 


Variable 

Multiple  R 

r2  r2  Change 

Group ; 

EDO 

GT 

.56 

.31 

31 

Education 

.61 

.37 

7 

Anxiety 

.67 

.44 

7 

Ind.  Score 

.68 

.46 

2 

Rotter 

.68 

.46 

0 

Group : 

FDS 

GT 

.46 

.21 

21 

Rotter 

.59 

.35 

14 

Education 

.66 

.43 

8 

Ind . Score 

.71 

.51 

8 

Anxiety 

.72 

.52 

1 

Group : 

IHD 

Rotter 

.58 

.34 

34 

Anxiety 

.60 

.36 

3 

GT 

.61 

.37 

1 

Ind.  Score 

.62 

.39 

2 

Education 

.63 

.40 

1 

Simple  R 

B 

Beta 

.56 

.12 

.41 

-.18 

-.96 

-.32 

-.53 

-.23 

-.37 

.18 

-.34 

-.18 

.22 

.06 

.08 

.46 

.20 

.51 

-.29 

-.24 

-.38 

-.26 

-.95 

-.54 

.13 

.36 

.39 

.13 

-.05 

-.12 

.58 

.63 

.45 

-.20 

.13 

.15 

.12 

.11 

.22 

.48 

.57 

.33 

.18 

-.41 

-.11 

and  GT  consistently  account  for  the  multiple  R.  The  only  difference  In  order 
Is  the  Introduction  of  anxiety  as  contributing  more  to  the  explained  variance 
than  GT  for  the  beginning  team  score.  The  magnitude  of  all  Independent 
variables  Is  less  In  the  second  regression.  As  stated  earlier,  the  similarity 
In  the  ordering  of  the  Independent  variables  was  expected  as  IND  subjects 
were  working  In  a similar  mode  during  both  lessons. 

On  the  other  hand,  the  FDO  and  FDS  subjects  were  working  In  a coordinated 
task  environment  during  the  beginning  team  lesson.  As  one  can  see.  In  compar- 
ing the  regressions  for  these  groups  the  order  and  magnitude  of  the  predictor 
variables  changes  significantly  from  individual  lesson  to  beginning  lesson. 

In  fact,  the  order  Is  nearly  reversed.  For  example,  the  orientation  measure 
(Rotter)  was  ordered  first  for  the  FDO  Individual  lesson  score.  For  the  FDO 
beginning  lesson  score  It  was  ordered  last.  The  R^  contribution  changed  from 
.25  to  0.  In  addition,  GT  and  Rotter  accounted  for  only  3%  of  the  R^  for 
the  FDS  individual  lesson  score.  For  the  FDS  beginning  score,  the  contribution 
of  these  two  variables  Increased  to  35%. 

In  short,  there  appears  to  be  little  stability  among  Independent  variables 
for  explaining  variance  In  scores  between  Individual  and  team  contexts.  It 
should  be  noted,  however,  that  the  analyses  were  based  on  the  Individual 
characteristics  of  the  team  members.  The  composite  of  the  teams  was  not 
Identified  and  used  as  an  Independent  variable.  It  may  well  be  that  by 
analyzing  combinations  of  member  characteristics,  more  systematic  explanations 
of  task  performance  could  be  derived. 

Role  Perception  and  Attltudlnal  Measures.  Data  collected  during  the 
emergent  team  lesson  included  subject  responses  to  four  tactical  scenario 
situations.  In  each  of  the  four  cases,  the  FDO,  FDS,  and  IND  subjects  were 
required  to  make  a decision  regarding  how  they  would  structure  the  team  In 
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order  to  perform  the  task  Involved  in  the  scenario.  In  regard  to  the  IND 
subjects,  the  decision-making  process  Itself  was  artificial  in  that  the 
individual  team  member  had  neither  worked  in  a team  mode  during  any  of  the 
previous  lessons  nor  would  be  working  with  another  individual  during  the 
emergent  team  lesson.  After  each  decision  was  made,  subjects  were  administered 
seven  items  which  related  to  their  confidence  in  the  decisions  and  their 
perceptions  of  the  roles  of  the  team  members. 

Table  11  presents  the  distribution  of  decision  responses  by  FDO,  FDS  and 
IND.  In  all  cases,  once  the  decision  was  made  subjects  received  hypothetical 
feedback  reporting  the  efficacy  of  the  decision  that  they  had  made.  As  can 
be  seen  in  Table  11,  the  three  responses  available  to  the  subjects  were  (1) 
to  totally  delegate  at  least  one  of  the  tasks  to  the  FDS,  (2)  to  delegate 
tasks  to  the  FDS  but  provide  monitoring,  and  (3)  not  to  delegate  any  tasks  to 
the  FDS.  In  each  case,  there  was  a preferred  response,  an  acceptable  response 
and  a wrong  response.  The  rating  of  the  responses  was  based  on  the  conqilexlty 
of  the  task  situation  and  the  criticality  of  the  combat  evolution. 

The  purpose  of  the  lesson  was  to  see  how  well  the  subjects,  particularly 
FDO,  responded  to  emergent  tactical  situations.  In  prior  lessons,  the  scenarios 
had  evolved,  in  essence,  frame  by  frame  with  each  combat  situation  building 
from  prior  events.  In  the  emergent  team  lesson,  the  subjects  were  presented 
with  a total  picture  and  the  parameters  of  particular  combat  situations. 

Also,  the  lesson  allowed  the  project  team  to  investigate  the  impact  of  a 
direct  team  feedback  message.  That  is,  in  the  past  the  team  members  were 
able  to  follow  the  performance  of  each  other  in  terms  of  their  error  rates 
and  time  for  responses  as  well  as  receiving  team  debriefings.  In  the  emergent 
team  lesson  the  feedback  message  only  had  to  deal  with  a hypothetical  outcome 
to  a tactical  decision.  A third  objective  of  the  lesson  was  to  collect  data 
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Table  11.  Distribution  of  Decision  Responses 
In  Emergent  Team  Lesson 


Delegate 

Del/Monitor 

Not  Delegate 

1st  Decision 

FDO 

3* 

6*^ 

1 

FDS 

!♦ 

8*^ 

1 

IND 

!♦ 

5** 

0 

2nd  Decision 

FDO 

1** 

e* 

3 

FDS 

1** 

1* 

2 

IND 

2* 

2 

3rd  Decision 

FDO 

4** 

3* 

3 

FDS 

3** 

5* 

2 

IND 

1* 

3 

4th  Decision 

FDO 

3** 

5^ 

2 

FDS 

3** 

3^ 

4 

IND 

5** 

0^ 

1 

^Acceptable  Response 
♦♦Preferred  Response 
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from  Che  individual  team  members  in  regards  to  their  confidence  in  the 
abilities  of  their  teammates  and  regarding  the  perception  of  their  roles 


within  the  team  context. 

As  can  be  seen  in  Table  11,  the  preferred  response  to  the  first  decision 
was  to  delegate  responsibility  and  continue  to  monitor  the  performance  of  the 
FDS.  The  preponderance  of  all  subject  groups  selected  this  response.  For 
the  remainder  of  the  decisions,  the  preferred  response  was  to  totally  delegate 
at  least  some  task  comprising  team  mission.  The  feedback  messages  related  to 
each  of  the  decision  choices  were  as  follows:  (1)  for  the  preferred  response, 
Che  feedback  message  in  essence  stated  that  the  team  had  performed  success- 
fully and  achieved  their  mission;  (2)  for  the  acceptable  response,  the  feed- 
back message  stated  that  the  team  was  partially  successful  in  achieving  their 
mission;  and  (3)  for  the  wrong  response,  Che  team  was  told  that  it  had  failed 
to  achieve  its  mission.  Each  of  the  feedback  messages  were  nnre  elaborate, 
and  the  feedback  was  constructive  in  Chat  it  explained  the  basis  for  the 
decisions  as  well  as  the  feedback  message.  It  is  Interesting  to  note  in 
Table  11  chat  after  the  second  decision  when  the  delegate/  monitor  response 
was  giving  only  a partially  successful  score,  a number  of  the  subjects  began 
to  switch  and  search  for  the  more  appropriate  response.  However,  except  for 
the  individual  subjects,  there  was  a continuing  dependence  on  the  delegate/ 
monitor  response  throughout  each  of  the  scenarios. 

The  responses  to  the  seven  confidence  and  role  perception  items  were  on 
a five  point  scale.  Table  12  contains  the  response  means  and  standard 
deviations  for  the  confidence  and  role  perception  items.  The  seven  items 
were  as  follows: 
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Table  12.  Heana  and  Standard  Deviations  For  Confidence 
and  Role  Perception  Itea  Responsea. 


Variable 

FDD 

X 

(S.D.) 

FDS 

X 

(S.D.) 

IKD 

X 

(S.D.) 

CONFID-1 

4.00 

(.94) 

4.20 

( .92) 

3.73 

( .94) 

COMFID-2 

4.00 

(.82) 

3.30 

(1.18) 

3.73 

( .94) 

COIfFID-3 

4.20 

(.79) 

3.30 

(1.33) 

2.73 

( .H) 

OOIIFIO-4 

3.80 

(.79) 

3.30 

(1.08) 

2.00 

(0.00) 

DISCUSS- 1 

4.00 

(.94) 

4.10 

(1.10) 

4.23 

( .94) 

FDOCON-1 

3.70 

(.48) 

3.90 

(1.29) 

3.73 

( .94) 

FDSCOM-l 

3.30 

(.83) 

3.80 

(1.03) 

4.23 

( .94) 

COIVCON-1 

4.30 

(.707) 

3.90 

( .99) 

4.73 

( .30) 

MISDKP-l 

4.30 

(.83) 

4.20 

(1.49) 

3.00 

(1.41) 

FD0>FDS-1 

3.00 

(.82) 

3.40 

( .70) 

3.23 

(1.24) 

1.  How  confident  are  you  In  the  PDO's  dccialon?  (CONFID-1,2,3,4) 

2.  Would  you  have  preferred  Co  diacuss  the  decision  with  the  FDO  before 
it  was  nadeT  (DISCUSS-1) 

3.  Should  the  FDO  conduct  fire  nissionaT  (FDOCOM-1) 

i.  Should  the  FOS  conduct  fire  aissionsT  (FDSCON-1) 

5.  Should  the  noat  conpetent  tean  neaber  conduct  the  fire  alssions?  (COHPON-1) 

h.  Who  conducts  Che  fire  aissions  should  be  dependent  upon  the  situation 
and  the  tean  aiaalon.  (NISDCF-1) 

1.  The  FDO  la  better  thea  the  FD6  at  coaductlnc  fire  alaaiona.  (FDO  > FDS-1) 
Overall,  the  reeponses  led  to  few  insights  regarding  individual  behaviors 
within  the  teaa  coateat  and  perceptions  of  the  roles  of  the  individuals.  The 
FDO  subjects  daaonatrated  a slightly  greater  confidence  in  the  decisions  that 
they  nade  than  did  the  FDS  subjects.  Ferhaps  nore  laportant  was  that  two 
iteas  «Alcb  received  high  scoraa  ware  3 and  6.  Thua,  both  teaa  aaabers 
perceive  that  the  strKturing  of  the  teaa  should  be  based  on  both  the  cos^etence 
of  the  iadivldual  teaa  aaabers  as  well  as  Che  characteristics  of  the  overall 
teaa  aisoion. 

Mo  aeasures  were  taken  of  the  Individual  neaber 's  attitudes  towards  the 
lessons  thaaaelves.  Howevst , it  should  be  noted  Chat  throughout  the  eaperl- 
'■antal  sessiona,  subjecta  frequently  coMonted  on  how  interesting  the  lessons 
were.  It  was  also  noted  by  the  project  teaa  that  during  the  debriefing 
seasions,  subjects  took  the  problen  seriously  and  quickly  began  to  calk  and 
behave  towards  one  another  as  if  they  were  working  in  an  actual  artillery 
coabat  environaent.  In  short,  the  richness  of  Che  scenario  seens  to  accoaplish 
ita  objective  of  getting  Che  subjects  iaaersed  in  the  training  situation. 


DISCUSSION 

Major  Team  Issues 

As  posited  in  section  two,  there  are  three  major  team  Issues  which 
should  be  considered  In  the  development  of  a program  of  team  training  or  team 
training  research.  These  Issues  are  team  definition,  conceptual  team  models, 
and  team  structure.  Clearly  definition  criteria  for  categorizing  multi- 
person operations  must  be  established.  For  the  present  study,  the  criteria 
Include  (1)  rigid  structure,  organization,  and  communication  networks,  (2) 
anticipation  of  an  individual’s  task  participation,  and  (3)  cooperation  and 
coordination.  This  definition  distinguished  the  team  from  a small  group  and 
from  lndlvld\ials  performing  Individual  tasks  In  a group  context. 

The  Issue  of  conceptual  team  models  Is  based  on  the  situational  context 
in  which  team  behaviors  occur.  Prior  research  Indicates  that  the  situational 
context  is  a continuum  stretching  between  end  points  which  may  be  described 
as  established  or  emergent.  Team  operations,  characteristically,  cannot  be 
ascribed  to  any  one  point  along  this  continuum.  On  the  contrary,  the  situa- 
tional context  of  team  task  performance  will  fluctuate  all  along  the  continuum. 

For  training  analysis.  It  Is  important  to  identify  the  critical  fluctuations 
and  to  represent  these  In  the  team  instructional  strategies. 

Team  structure,  serial  or  parallel,  drives  the  types  of  team  member 
Interaction  required  In  the  performance  of  team  tasks.  Thus,  the  Identifica- 
tion of  the  form  of  the  team  structure  at  each  task  mode  Is  a vital  Input  to 
the  design  of  training  events  and  to  the  development  of  team  Instructional 
strategies.  Both  serial  and  parallel  structured  events  occur  within  the 
situational  continuum. 

In  summary,  these  issues  point  out  that  team  operations  are  comprised  of 
a number  of  dimensions:  the  defined  Interrelationship  of  the  members,  the 
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team  mission  and  Casks  to  be  performed,  the  structure  of  the  team  vis-a-vis 
Casks,  and  environmental  eonditlons.  In  the  deveK'pmeni  I'l  a iralnln^',  proKiaiu, 
a job/cask  and  training  analysis  Chat  will  yield  the  required  information 
regarding  each  of  these  elements  should  be  employed.  In  the  design  of  a 
research  program,  each  of  these  considerations  must  be  weighed  against  the 
established  purpose  of  the  research.  As  can  be  seen,  these  major  Issues  have 
driven  the  methodologies  for  achieving  the  stated  project  tasks. 

A Conceptual  Framework  for  COLT^  Instructional  Strategies 

The  conceptual  framework  is  based  on  the  definition  of  an  instructional 
strategy  as  the  product  of  a series  of  decisions  which  lead  to  the  sequencing, 
structuring  and  specifying  of  learning  events  and  activities.  It  was  concluded 
that  the  information  underlying  these  decisions  is  related  to  the  characteris- 
tics of  (1)  the  task  to  be  learned,  (2)  the  learner,  and  (3)  instructional 
delivery  system.  In  turn,  team  Instructional  strategies  must  account  for  the 
variables  representing  each  of  these  dimensions  within  a context  typically 
requiring  multi-person  interactions.  That  is,  the  coordinating  and  cooperative 
behavior  present  in  the  job  must  also  be  present  in  the  training. 

From  the  team  task  dimensions  identified  in  the  literature  and  through 
interviews  with  team  training  Instructors,  three  categories  of  team  learning 
were  developed  to  serve  as  a link  between  team  job/task  analysis,  team  train- 
ing objectives  and  team  Instructional  strategies.  The  three  learning  categories 
were  knowledge  of  team  roles,  team  attitudes,  and  team  communications.  Each 
of  the  categories  are  discussed  in  greater  detail  in  section  three.  It 
should  be  noted,  however,  that  these  three  learning  categories  were  derived 
analytically  and  have  not  been  empirically  tested. 

Learner  characteristics  and  strategies  which  are  described  and  discussed 
in  this  report  were  limited  to  those  related  to  individual  behavior.  Emphasis 


82 


was  given  to  characteristics  which  Impact  on  the  ability  of  the  student  to 
process  Information,  communicate,  make  decisions  and  to  solve  problems  In  a 


coordinated  task  environment.  In  terms  of  Individual  learner  strategies, 
three  categories  were  discussed  In  section  three.  The  categories  were  made 
up  of  comprehension,  memory,  and  problem-solving  strategies. 

Both  learner  characteristics  and  strategies  may  be  used  as  the  basis  for 
COLT^  Instructional  strategies  In  the  form  of  preprogrammed  decisions  for 
teaching.  Preprogrammed  decisions  frequently  are  a function  of  projected 
trait  or  entry  attributes.  To  some  extent,  consideration  of  state  character- 
istics such  as  the  performance  on  the  last  task  or  the  current  state  of 
anxiety  departs  from  the  concept  of  entry  behavior  description  because  these 
measures  may  be  used  as  dynamic  Indicators  of  a learner's  state.  Learner 
characteristics  and  strategies,  however,  to  be  relevant  to  COLT^  must  allow 
for  analysis  of  learner  characteristics  which  will  be  used  In  designing 
Instructional  strategies  and  those  which  will  be  used  In  the  instructional 
manipulations  In  a real-time,  dynamic.  Interactive  mode. 

The  third  dimension  of  the  conceptual  framework  focused  on  the  capability 
of  the  Instructional  medium,  CAI.  COLT^  Instructional  strategies  will  reflect 
hardware  and  software  capabilities  present  In  the  selected  CAI  system  and  the 
operating  system  available.  In  short.  Instructional  strategies  are  delimited 
[ by  the  medium  through  which  the  learning  Is  to  occur. 

The  conceptual  framework  served  well  as  an  organizer  of  the  Instructional 
strategy  data  base.  However,  there  are  two  deficiencies  in  the  framework. 
First,  the  data  base  does  not  encompass  theoretical  and  empirical  knowledge 
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related  to  small  group  behavior  which  may  be  applicable  to  team  training 
Instructional  strategies.  Most  Important  among  these  would  be  the  process 
paradigms  reflecting  the  different  types  of  contextually  related  Interpersonal 
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relationships.  Identification  of  these  processes  may  significantly  contribute 
to  the  development  of  evaluation  paradigms  as  part  of  an  Instructional  system 
development  model  for  team  training.  Secondly,  while  the  conceptual  frame- 
work served  well  for  organizing  the  data  base.  It  lacked  procedural  guidelines 
for  translating  the  data  Into  actual  Instructional  strategies  for  specific 
TACFIRE  team  training  problems. 

Implementation  of  a Team  ISD  Model 

Section  four  contains  a description  of  the  design  and  Implementation  of 
the  team  ISD  model  for  the  purpose  of  the  brassboard  development.  The  major 
con^onents  of  the  approach  Included  job/task  analysis,  development  of  team 
learning  objectives,  and  scenario  development  inclusive  of  Instructional 
strategies . 

The  team  ISD  model  employed  In  this  project  has  notable  strengths  and 
weaknesses.  Foremost  among  Its  strengths  was  Che  efficacy  of  Implementing 
the  job  task  and  training  analysis.  The  analysis  methodology  based  primarily 
on  the  work  of  Glanzer  (1961)  yielded  the  discrete  tasks  comprising  the 
TACFIRE  fire  mission  with  both  situational  context  and  team  structure  dimen- 
sions Identified.  The  job/task  flowcharts  developed  from  this  analysis  also 
proved  exceptionally  efficient  as  vehicles  for  translating  the  job/task  and 
training  analysis  into  training  scenarios  reflecting  not  only  the  task  to  be 
performed  but  also  the  environmental  conditions  to  be  simulated. 

The  weaknesses  of  the  team  ISD  model  were  in  two  directly  related  areas. 
First,  a distinct  deficiency  of  the  model  was  revealed  in  the  formulation  of 
team  learning  objectives.  The  model  lacks  the  methodology  for  preparing 
terminal  and  enabling  objectives  and  analyzing  the  objectives  by  learning 
category.  This  deficiency  Is  also  related  to  the  lack  of  evaluation  procedures 
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in  the  model.  More  specifically,  evaluation  of  the  member  acquisition  of 
team  skills  (l.e.,  coordinating  and  cooperative  behaviors)  is  not  present. 

In  summary,  the  ISD  model  offers  a sound  base  for  developing  team 
instructional  strategies  and  team  training.  However,  the  model  is  not  suf- 
ficiently detailed  to  lend  itself  as  an  operational  or  procedural  guide  for 
the  general  production  of  team  training  curricula. 

PLANIT  Implementation 

The  PLANIT  implementation  was  described  in  terms  of  the  team  training 
considerations  of  (1)  storage  and  retrieval  of  information  related  to  scenario 
events,  communications,  learning  events  sequences,  and  student  performance 
via  the  common  data  base,  (2)  initialization  of  lessons,  (3)  synchronization 
of  team  members  to  scenario  events,  and  (4)  communications  among  team  mem- 
ber 4.  Section  four  describes  how  these  team  CAI  considerations  were  matched 
with  the  PLANIT  team  training  directives  in  the  development  of  the  team 
training  brassboard.  The  present  discussion  will  emphasize  the  problems 
encountered  in  the  development  of  the  brassboard  and  potential  enhancements 
of  the  PLANIT  team  training  version.  Among  the  proposed  enhancements  will  be 
some  considerations  for  authoring  capabilities. 

The  common  data  base  implemented  in  PLANIT  was  adequate  for  programming 
the  instructional  strategies,  tracking  of  events,  and  sjmchronization  of  the 
subjects  to  scenario  events.  The  use  of  the  common  data  base  for  these 
purposes  involved  only  a matter  of  appropriate  design  of  the  matrix  in  PLANIT. 
However,  if  team  training  lessons  in  the  future  are  to  be  Implemented  by  Army 
instructional  personnel,  then  it  may  be  desirable  to  provide  commands  with 
parameters  to  set  the  values  of  the  common  data  base  indicating  sequences  of 
events,  automatic  designation  of  terminal  values,  and  synchronization  require- 
ments. It  is  recognized  that  to  make  the  matrix  a primitive  would  consume 
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space  and  likely  add  unwanted  constraints  on  author  flexibility.  However,  If 
the  lesson  can  be  designed  and  coded  by  an  Instructor,  time  savings  and  cost 
effectiveness  could  be  realized.  One  possibility,  for  example,  might  be  that 
the  author  could  designate  a directive  HOLD  with  par2UDeters  Indicating  the 


frame  labels  on  which  a team  member  might  be  held.  A HOLD  directive  parameter 
would  also  have  to  designate  the  other  team  members  with  which  the  holding 
action  would  be  compared.  Thus,  synchronization  parameters  could  be  established 
In  a preformed  matrix  with  authoring  directives  for  either  sequencing  events 
or  holding  students. 

The  PLANIT  system  could  automatically  put  the  frame  numbers  of  these 
labels  In  the  data  base  with  the  designated  terminal  values  for  determining 
which  program  was  operating.  When  a label  was  reached  and  a frame  executed, 
the  frame  counter  for  comparison  and  branching  (similar  to  the  use  of  matrix 
cell  X(3,3,l))  would  be  automatically  Implemented.  In  this  way,  the  burden 
of  building  specific  synchronization  techniques  as  well  as  the  design  of  the 
common  data  base  would  be  taken  off  the  shoulders  of  the  author. 

In  the  lessons  Implemented  for  the  study,  all  content  of  the  communications 
was  canned.  That  Is,  the  messages  were  preprogranmned  as  part  of  the  lesson 
data  base.  To  allow  the  student  to  make  up  his  own  message  Is  also  possible 
within  PLANIT  via  student-initiated  DIAL  directives.  In  this  manner,  the 
student  controls  the  content.  This  capability  was  not  used  In  the  lessons 
developed  because  there  are  distinct  Implications  for  both  Instructional  and 
evaluation  strategies. 

For  the  purpose  of  the  brassboard  several  Instructional  strategies  for 
teaching  team  communications  were  considered  but  not  Implemented  because  of 
current  PLANIT  restrictions.  For  example.  Instead  of  asking  an  FDO  subject 
to  select  the  appropriate  action  by  number  and  sending  the  canned  message  to 
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his  FDS  partner.  It  was  possible  to  allow  a free  Interchange  of  DIAL  messages 
between  the  two.  If  such  a strategy  were  followed  with  rules  defining  the 
FDO  and  FDS  roles.  It  might  be  more  beneficial  for  transfer  to  the  actual 
target  task  than  the  strategy  employed.  However,  at  present,  there  Is  no 
capability  to  record  or  diagnose  such  an  Interchange  automatically. 

If  messages  could  be  stored  and  searched  for  key  words  or  phrases,  CAI 
strategies  could  be  employed  to  diagnose  the  state  and  content  of  communications. 
This  Information  would  allow  prompting.  Interception  of  messages  from  one 
member  to  another,  or  branching  strategies.  Without  the  capability  to  store 
and  diagnose  the  message,  the  Interchange  Is  not  only  free  form  but  so  are 
the  instructional  strategeles. 

It  Is  also  desirable  to  have  PLANIT  authoring  strategies.  Such  strategies 
would  have  the  purpose  of  providing  a framework  In  which  the  logical  and 
empirical  basis  for  team  training  Is  associated  with  authoring  techniques. 

In  this  way  the  Instructional  technology  of  team  training  can  be  taken  Into 
account.  The  general  design  used  In  lesson  building  for  this  study  was  to 
sequence  lessons  according  to  four  levels:  (1)  Individual,  (2)  beginning 
team,  (3)  Integrated,  and  (4)  emergent  team.  These  levels  may  be  directly 
tied  to  the  modes  of  the  CAI  team  training  as  each  relates  to  the  student 
characteristics,  the  Instructional  objectives,  and  the  Instructional  strategies. 
That  Is,  some  CAI  modes  may  be  more  or  less  appropriate  at  each  level  of  team 
training.  For  example,  using  the  CAI  modes  listed  by  Hickey  (1968),  one 
might  find  the  match  of  CAI  modes  with  lesson  level  as  presented  In  Table  13. 
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Table  13.  Exaiqple  of  Match  of  Team  Lesson  Levels 


With  CAI  Modes 

Lesson  Level 

CAI  Mode 

1. 

Beginning  Team 

Drill  and  Practice 

Tutorial 

Testing 

2. 

Integrated  Team 

Socratic  Tutorial 

Simulation 

Testing 

3. 

Emergent 

Simulation 

Game 

Learner  Controlled 

Testing 

f The  advantage  of  an  author  strategy  can  be  Illustrated  by  describing 

I 

f. 

t current  scenario  Implementations  common  to  'team  training'  for  all  branches 

[ 

! of  the  military.  The  scenarios  characteristically  begin  with  simple  events 

with  long  lead  times.  As  the  student  progresses  through  the  scenario,  events 
increase  in  number  and  difficulty.  The  instructional  strategy  tisually  is 
drlll-and-practlce  and  testing  with  task  (mission)  achievement  being  the  only 
measured  outcome.  Seldom  are  tutorial,  simulation,  learner  controlled,  or 
game  strategies  employed.  If  COLT^  is  to  be  more  than  a drill  and  practice 
experience,  the  training  scenarios  must  be  rich  with  team  instructional 
strategies. 

Brassboard  Demonstration/Evaluation 

As  described  in  the  preceding  section,  subjects  for  the  brassboard 
deiDonstratlon/evaluatlon  were  40  Army  enlisted  men  from  commands  in  the 
Washington  area.  Eight  of  the  subjects  trained  on  the  brassboard  in  an 
individual  mode;  the  remaining  32  were  placed  in  two-man  teams.  One  team 
member  randomly  was  selected  to  serve  as  the  FDO.  The  other  man  was  the  FDS. 


88 


Drill,  tutorial,  problem  complexity  In  sequencing,  and  Individual 
feedback  strategies  were  the  same  for  all  subjects.  The  teams,  however, 
worked  through  the  beginning  team  lesson  and  selected  frames  of  the  Integrated 
and  emergent  lessons  In  a coordinated  mode.  In  addition,  team  debriefings  at 
the  conclusion  of  the  lessons  were  more  extensive,  with  team  members  being 
apprised  of  each  other's  performance  and  having  the  opportunity  to  discuss 
future  role  assignments. 

A few  minor  problems  were  encountered  In  the  evaluation  of  subjects.  It 
was  not  possible  to  acquire  lesson  times  for  the  first  eight  subjects.  Minor 
modifications  of  PLANIT  corrected  this  problem.  Second,  the  responses  made 
by  subjects  were  not  recorded  Initially.  The  only  record  that  was  stored  was 
the  correct  response  to  the  Item  and  whether  the  subject  was  right  or  wrong. 
This  resulted  In  a problem  In  deriving  performance  scores  as  one  response 
choice  was  a query  for  Information  and  should  have  been  scored  as  a neutral 
response.  Again,  a minor  modification  to  PLANIT  was  required  to  correct  the 
problem. 

The  conclusions  to  be  drawn  from  the  data  collected  during  the  demonstra- 
tion/evaluation are  limited.  This  Is  due,  for  the  most  part,  to  the  limited 
number  of  subjects  and  to  the  few  problems  encountered  In  the  data  collection 
Itself.  However,  comparisons  of  team  and  Individual  subject  performance, 
regression  analyses  of  Individual  and  team  scores,  and  analysis  of  student 
attitudes  and  role  perceptions  towards  the  Instruction  lend  themselves  to 
some  Interesting  observations. 

A critical  question  regarding  team  training  Is  whether  or  not  the  types 
of  learning  which  occur  In  coordinated  training  differ  from  the  learning  that 
takes  place  In  Individual  training.  Several  outcomes  of  the  evaluation 
Indicate  that  this  very  well  may  be  the  case  and  may  warrant  subsequent 
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Investigation.  In  the  across-lesson  performance  of  the  groups,  it  should  be 
noted  that  the  coordinated  training  received  by  FDO  and  FDS  subjects  did  not 
appear  to  substantially  Increase  their  individual  skills.  On  the  other  hand, 
the  team  performance  on  coordinated  tasks  was  better  than  the  IND  subjects 
who  were  working  on  the  same  tasks  in  an  individual  mode.  In  short,  it 
appears  that  team  trained  subjects  acquire  skills  other  than  task  proficiency. 
Moreover,  those  skills  contribute  to  effective  job  performance. 

A second  indication  that  different,  but  critical,  skills  are  being 
learned  in  the  team  training  environment  is  derived  from  stepwise  regression 
analyses  of  individual  and  beginning  team  lesson  scores.  There  is  little 
consistency  among  Independent  variables  for  explaining  variance  in  scores 
between  individual  and  team  contexts.  On  the  other  hand,  across  individual 
scores,  there  is  much  greater  stability  in  the  explanation  of  variance. 

Further,  the  correlation  coefficient  between  lesson  performance  for  IND 
subjects  was  .48.  The  correlation  coefficient  between  individual  performance 
and  team  performance  for  the  FDO  subjects  was  .18  and  for  FDS  subjects,  .13. 

The  differences  are  substantial. 

In  regard  to  role  perception  and  attitude,  there  also  were  some  interesting 
observations.  On  all  four  confidence  items,  FDO  and  FDS  subjects  indicated 
that  they  were  more  confident  of  the  decisions  made  than  were  IND  subjects. 

While  it  is  difficult  to  explain  the  differences,  it  appears  that  the  inter- 
active, decision  making  training  resulted  in  greater  confidence  in  self  and 
other  team  members.  One  other  point  of  difference  between  team  and  individual 
role  perception  relates  to  the  perceived  dependence  of  team  structure  on 
mission.  Team  subjects  perceived  this  dependence  to  be  significantly  more 
Important  than  did  individual  subjects.  Thus,  team  training  may  contribute. 
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to  a large  degree,  to  Increased  awareness  of  tactical  environmental  conditions 
as  well  as  self  and  other  team  member  competence. 

A final  remark  regarding  attitudes  Is  warranted.  As  stated  earlier, 
many  of  the  subjects  favorably  commented  as  to  their  Interest  In  the  lessons. 
The  progressions  or  levels  of  training,  with  their  Increasing  reliance  on 
tactical  combat  simulation  and  gaming,  seem  to  stimulate  subject  motivation 
and  Interest.  This  occurred  In  spite  of  the  fact  that  the  coordinated 
lessons  ran  extremely  slow,  and  subjects  did  have  Idle  time  between  frames. 

In  summary,  the  results  of  the  Initial  COLT^  brassboard  demonstration/ 
evaluation  support  the  basic  tenets  underlying  the  methodology.  Representing 
the  situational  context  of  the  job  performance  Is  critical  to  effective  team 
training.  Analysis  of  team  structure  In  the  performance  of  jobs  can  yield 
dimensions  of  team  mendier  Interactions  which  may  be  critical  to  job/task 
proficiency  yet  are  distinct  from  Individual  proficiency  skills.  Finally, 
these  separate  and  distinct  team  dimensions  can  be  successfully  subsumed, 
along  with  relevant  Individual  training  dimensions,  under  team  Instructional 
strategies.  Further  research  Into  each  of  the  topics  covered  In  the  discussion 
should  lead  to  clarification  of  the  relationships  which  exist  among  the 
topics  and  contribute  to  a comprehensive  team  ISD  model. 
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RECOMMENDATIONS 


The  following  recommendations  are  categorized  as  they  relate  to  the 
(1)  development  of  a team  ISD  model,  (2)  enhancement  of  the  team  training 
version  of  PLANIT,  and  (3)  team  training  research  requirements. 

Recommendations  for  Developing  a Team  ISD  Model 

The  Implementation  of  the  team  ISD  model  revealed  a number  of  strengths 
and  weaknesses.  These  were  discussed  In  the  previous  section.  Generally, 
however,  the  model  Is  Insufficiently  fleshed  out  to  serve  as  a step~by-step 
procedural  guide  to  the  development  of  team  Instruction.  The  following 
paragraphs  contain  specific  recommendations  for  addressing  the  weaknesses  of 
the  model. 

The  conceptual  framework  for  COLT^  instructional  strategies,  established 
In  this  project,  has  two  major  deflclences.  First,  It  does  not  Incorporate 
applicable  knowledge  related  to  small  group  behavior.  Second,  while  the 
framework  serves  well  as  a vehicle  for  organizing  a team  Instructional 
strategies  data  base.  It  does  not  lend  Itself  to  the  specification  of  actual 
strategies  for  a specific  training  problem.  Recommendations  are: 

1.  Applicable  small  group  behavior  knowledge  should  be  Incorporated 
Into  the  team  Instructional  strategies  data  base. 

2.  The  potential  for  developing  procedural  algorithms  which  optimally 
mix  the  training  specifications,  trainees,  learning  activities,  and 
Instructional  delivery  systems  should  be  Investigated. 

Most  Important  the  model  did  not  yield  adequate  learning  objectives 
representing  team  training  requirements.  Consequently,  the  model  does  not 
provide  adequate  evaluation  paradigms  for  assessment  of  team  skills  and 
measurement  of  the  objectives.  That  Is,  while  It  Is  possible  within  COLT^  to 
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evaluate  individual  and  team  achievement  and  the  procedures  for  doing  so  are 
relatively  straightforward,  the  Interactive  processes  are  not  assessed.  In 
view  of  this  the  following  recommendations  are  offered: 


3.  Specific  directions  for  preparing  team  terminal  smd  enabling  learning 
objectives  should  be  developed.  Included  should  be  a methodology  for 
appropriately  categorizing  objectives  by  types  of  team  learning  to 
occur. 

4.  Process  evaluation  paradigms  for  assessing  team  Interactive  behaviors 
should  be  Investigated  In  terms  of  their  potential  for  appropriately 
being  matched  with  specific  team  situations  as  defined  by  team  tasks, 
team  structure,  and  environmental  conditions.  To  be  applicable  to 
COLT^,  evaluation  models  would  have  to  be  amenable  to  PLANIT  pro- 
gramming . 

Recommendations  for  PLANIT  Enhancements 

The  operational  requirements  for  a team  version  of  the  PLANIT  CAI  system 
fell  Into  four  categories:  (1)  a common  data  base  to  be  used  for  program 
control,  event  tracking,  and  Indlvldual/team  record  storage  and  analysis; 

(2)  initialization  of  common  lessons;  (3)  synchronization;  and  (4)  communica- 
tions. The  following  recommendations  reflect  this  categorization. 

5.  The  establishment  of  a common  matrix  as  a primitive  should  be 
considered.  Although  such  an  action  would  constrain  the  implementa- 
tion of  instructional  strategies  (l.e.,  reduce  the  flexibility  of 
the  author  to  manipulate  program  logic) , there  would  be  considerable 
gain  In  facilitation  of  authoring.  Matrix  parameters  could  be  set 
for  preprogrammed  analysis  of  Individual  and  team  responses  In 
order  to  dynamically  manipulate  students  and  Instruction.  Predefined 
matrix  parameters  would  be  tied  to  the  following  recommendations 
regarding  synchronization  and  communications. 

6.  Team  lessons  require  synchronization.  Currently  the  required 
coordination  Is  available  only  via  development  of  tailored  program 
logic.  A synchronizing  directive  would  reduce  the  current  require- 
ment that  the  author  have  extensive  knowledge  of  PLANIT  programming 
techniques. 

7.  Free  text  or  partial  free  text  communications  which  are  terminal 
initiated  are  a desirable  feature  of  COLT^.  However,  the  current 
PLANIT  team  version  does  not  have  the  capability  to  record  and 
analyze  this  type  of  message.  This  capability  Is  required  If 
student  performance  analysis  and  problem  diagnosis  are  to  be  Incor- 
porated In  team  instructional  strategies. 
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8.  Minor  modlf Icaclons  In  message  characteristics  are  being  addressed. 
Foremost  among  them  are  message  identification,  message  length,  and 
queuing  considerations.  Dr.  Charles  Frye  is  presently  working  on 
some  of  these  problems. 

9.  Authoring  strategies  for  COLT^  should  be  developed.  Such  strategies 
would  direct  and  teach  the  instructor-author  to  create  Instructional 
strategies  which  optimally  configure  student  Interactions,  learning 
events,  and  CAI  modes  available  in  FLANIT. 


Recommendation  for  Future  COLT^  Research 

Given  the  positive  findings  of  the  present  study,  continued  testing  of 
C0Lt2  instructional  strategies  so  that  their  full  potential  and  applicability 
can  be  realized  Is  recommended.  Specifically: 

10.  COLT^  research  focusing  on  the  relationships  between  team  personnel 
composites,  performance,  and  Interactions  should  continue.  The 
proposed  research  would  require  an  extensive  experimental  effort  In 
order  to  establish  a data  base  of  discriminant  team  characteristics. 

The  critical  factor  then  would  be  to  define  the  relationships  of 
between  team  characteristics  and  differential  Instructional  treatments. 

11.  In  order  to  fully  assess  the  Impact  of  team  training,  process 
evaluation  models  that  track  team  member  interaction  and  identify 
non-task  proficiency  skills  should  be  Investigated.  Thus,  types  of 
team  Interactions  and  ’team  skill'  acquisition  could  be  related  to 
task  achievement  within  environmental  and  team  structure  contexts. 

12.  Further  research  on  the  effectiveness  of  presenting  team  training 

by  levels  related  to  tactical  complexity  and  evolutions  Is  certainly 
required  given  the  promising  trends  found  In  the  present  study.  In 
addition,  such  an  Investigation  should  focus  on  determining  If 
learning  stabilizes  across  mixes  of  individual  and  team  Instruction. 
Positive  findings  would  significantly  Impact  on  both  computer-based 
and  noncomputer-based  team  training. 
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